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Extending the Challenge : 
■ Working Toward a Common Bodjy of Practice for Teachers 

■»■«.. 

Concerned educators have always wrestled with issues of excellence and pro- 
fessional development. It is' argued in the paper, "A Common Body of Practice 
for Teachers: The Challenge of Public Law 94-142 to Teacher Education,"* that 

,the Education for All Handicapped Children Act of 1975 provides the necessary im- 
petus for a concerted reexamination of teacher education. Further, it is argued 
that this reexamination should enhance the process of establishing a body 'of 
knowledge common to the "members of the teaching profession. The paper continues, 

i then, by outlining clusters of capabilities that may be included in the common 
■body of knowledge.. These clusters of capabilities provide the basis for the fol- 

"lowing materials. , 

The materials are oriented toward assessment and development. First, the 
various components, rating scales, self-assessments, sets of objectives , and re- 
spective rationale and knowledge bases are designed to enable teacher educators 
to'assess current practice relative to the knowledge, skills, and commitments 
outlined in the aforementioned paper. The assessment is conducted not necessarily 
to determine the worthiness of a program or practice, but. rather to reexamine cur- 
rent practice in order to articulate essential common elements of teacher educa- 
tion. In effect then* the "challenge" paper and the ensuing materials incite 
further discussion regarding a common body of practice for teachers. 

Second, and closely aligned to assessment, is the developmental perspective 
offered by these materials. The assessment process allows the user to view cur- 
rent practice on a developmental continuum. Therefore, desired or more appropriate 
practice is readily identifiable. "On another, perhaps more important dimension, 
the "challenge" -paper and these materials focus discussion on preservice teacher ' 
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education/ In making decisions regarding a common body of practice, 1 it is esscn- 

» ...... 

tial that specific knowledge ;. ski 1 1 and commitment be acquired at the pre^ervice 
level. It is also essential that other additional specific knowledge, skill, and 
commitment be acquired as a teacher lV inducted into the profession and matures 
with years of experience. ? Differentiating among these levels of 'professional 

V 

development is paramount. These materials can be used in forums in which focused 

(■ _ 

discussion will explicate better the necessary elements of prejservfce teacher 

! 

education. This explication will then al lowf more productive discourse on the 
necessary capabilities of beginning teachers and the necessary capabilities of 

v * 

experienced teachers. 

In brief, this work is an effort to capitalize on the creative ferment of 
the teaching profession in striving toward excellence and professional develop- 
ment. The work is to be viewed as 'evolutionary and formative. Contributions 
from our colleagues are heartily welcomed. « . * • ■ 

This paper presents one module in a series of resource materials which are 
designed for use by teache r edre ators. The genesis of these materials is in the 
ten "clusters of capabilities," Ajtlined in the paper, "A Commor^Body of Practice 
for Teachers: The Challenge of Public Law 94-142 To Teacher Education," which 
form the proposed core of professional knowledge needed by professional teachers', 
who will practice 'in ^the world of tomorrow. The resource materials are to be'used 
by teacher educators to reexamine and enhance their current practice in preparing 
classroom te^kQhers', -to work competently and comfortably with children who have a 
wide range of individual needs. Each module provides further elaboration of a 
specified "cluster of capabiliti'es'"--in this case, assessment and evaluation pro-* 
cedures. This parti ((ular module is a revision of an earlier module developed .by 
the authors for the School Psychology Inservice Training Network, Department of 
Psych oeducationaV, Studies, University of Minnesota, directed by James Ysseldyke, 
and Richard Weinberg. This module was one of several originally developed under 
the editorship of ■; Thomas Oakland, University of Texas, on the topic of non-biased 
assessment. \ : 




■ASSESSMENT- AND EVALUATION PROCEDURES * 



, The competency domain which includes knowledge and skill ilf "assessment 
and evaluation procedureV'; is one of,, critical importance" .in fulfilling both. the 
mandate* 1 and' spirit -of Public Law 94-142. In the past, teachers have tended to 
function as recipients of assessment and evaluation results. These results 
were most frequently presented to teachers in justification for what diagnostic 
specialists thought should be done, with or to individual students. 

Today, classroom teachers are called upon to be much more actively involved 
in student assessment and evaluation. Their participation is important to the 
interdisciplinary- evaluation process, and their ability to assess student skills 
and progresses vital to carrying out the Individualized Educational Plan (IEP). 

To carry out these responsibilities on tfie one hand, teachers need to know 
much more about. issues and assumptions involved in traditional methods of 
psychoeducational assessment. They need to be familiar with both the uses and 

abuses of diagnostic assessments aad_they need £q_ be„ sens! tiy_e_.tA the.. bias 

which often enter into these assessments. In effect, they must be enlightened 

consumers and monitors of this process. 

/ 

On the other hand, teachers need to be better able to participate actively 

in assessments which focus less on student characteristics and more on student 

skills, student needs and the instructional environment. It is in this area 

that Public Law 94-142 most challenges those involved in the assessment process. 

t 

The principle that student assessment should lead to an individualized program ' 

appropriate to the needs of the individual child requires far more than the 

categorization of children through diagnostic procedures. On the contrary, 
* 

Public Law 94-142 requires that a student's present skills be known and progress 



toward reasonable goals be monitored. This requirement in the assessment 
process distinctly falls in the realm of good teaching. ^ 

The materials presented here are designed to provide faculty members of 
colleges of education with information and activities to help prepare regular 
'class teachers to undertake their vital role in the assessment and evaluation 
process. The contents focus on what teachers should, know about standardized 
psychometric evaluations and.also on assessment procedures which can and ought 
to be carried out by classroom teachers themselves. 'Since this module only 
outlines a few , of the most important issues regarding assessment and evaluation 
procedures, references have been listed in the back of the module that elaborate 
on these issues. 

Other modules in the total set are related to this topic. The following 
should be noted in particular: 

9A: Writing goals, objectives^and IEPs; 

ioa^ ~ -Educating handicapped children: _ Judicial and legislative 

influences; ' s 
8A: Formal observation of students' social behavior; 
4A: The functions and responsibilities of support personnel. 
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Contents 

Within this module are the following components: 
Set of Objectives . The objectives focus on the teacher educator 
rather than on a student (preservice teacher).* The objectives* iden- 
tify what can be expected as a result of working through the materi- 
als. The objectives which apply -to teachers are also identified. 
They are statements about skills, knowledge and attitudes which r 
should be part of the "comrron body. of practice" of all teachers. 

.T 

Rating Scales. Scales are included by which a. teacher educator 
could, in a cursory way, assess the J degree to which the knowledge 
and practices identified in this module are prevalent in the exist- 
ing teache retraining program. The rating scales also provide a 
catalyst for further thinking in each area. v \ 

Sel f-Assessment . Specific test items were developed to determine 
a user's working knowledge .of the major concepts and principles 
in each subtopic. The self-assessment may be used as a pre-assess- 
ment to determine whether one would find it worthwhile to go through 
the module, or as a self-check after the materials have been worked 
through. ' The self -assessment items also can serve as examples of 
mastery test questions for students. 

Rationale and Knowledge Base. The brief statement summarizes the 
knowledge base and empirical support for the selected topics on pupil 
assess;. ?nt .• The more salient concepts and strategies are reviewed. 
A few brief simulations/activities and questions have been 1nte- 
grated with the rationale and knowledge base. 



Bi bliography . A partial bibliography of important books, articles 
and materials is included' after the list of references. 

Articles . Five brief articles (reproduced with authors' permission) 
accompany the aforementioned components. The articles support and 
expand on the knowledge base* 
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Objectives 

On completing this module, you will be able to identify appropriate "and 
inappropriate procedures for assessing students with consideration of the fol- 
lowing conceptual , methodological andethical issues:' . 

1. The testing debate; * 

2. The educational role of professionals and Public Law 94-142; 

3. Assessment methodology; 

4. Relevant assessment variables; 

5. Assessment procedures; 

6. Norm- referenced and criterion-referenced assessment; 

7. The relationship between assessment and .instruction; 

8. Evaluation of intervention effects; — * 

9. Interpretation and communication of assessment information. 

Reasonable Objectives for Teacher Education 

-■ Students should have knowledge, practical skills and commitment to pro- 
fess ionaK performance in the- following areas relating to assessment and evalu- 
ation procedures: ■ . ■ > 

1. * Methods and underlying assumptions, issues and biases of norm-refer- 

enced psychoeducational assessment. 

2. Appropriate and inappropriate uses of norm- referenced and criterion- 
referenced assessment. 

3. Administering and interpreting norm-reference^' and criterion- referenced* 
assessment instruments, 

4. Developing criterion-referenced assessment procedures directly 
relevant t$ the curriculum of a classroom. 



"Rating Scale for the Teacher Preparation Program 

Check the statement .that best describes the level of your presept teacher 
education program on the topic of assessment and evaluation procedures: 

1. Students being prepared for teaching have been introduced to educational 

and psychological assessment, but have little understanding of the issues 
and assumptions in traditional psychometrics . They see their own role in 
student assessment and evaluation primarily as giving grades. They see 
other forms of assessment and evaluation as being in the realm of spe- 
cialists . * • 

2. Students being prepared for teaching have received instruction on the 

issues, assumptions and methods of standardized testing. They have 
learned how standardized instruments are developed and how results are 
to be interpreted. They perceive standardized normative assessment $ 

■v 

procedures as adequate measures of Student abilities. 
3. Students being prepared for teaching are taught the issues and assump- 

: v . ' v 



tions underlying both norm- referenced and criterion-referenced assess- 
ment. They perceive both as useful when used appropriately, but have 
Irittle or no experience in actual assessments. 
4. Students being prepared for teaching are taught the issues and assump- 
tions underlying both norm-referenced and criterion-referenced assess- 
ment. Students are given practical experience using and interpreting 
norm-referenced and criterion-referenced instruments. 
&, Students being prepared for teaching are taught the issues and assump- 
^ tions underlying both norm- referenced and criterion-referenced assess- 
ment. Students have* practical experience using and interpreting com- 
mercially developed norm- referenced and criterion- referenced assessment 
based on the curriculum of a particular c^ass. 

• 10 
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X . Self-assessment 

\ .. ' ' . ;■ 

The following items are intended to assess^ your understanding of the 
significant issues in educational assessment. 

Short Answer Items 

1. Define the purpose of educational assessment. 

2. What is the difference between testing and assessment? 

3. Outline the requirements of Public Law 94-142 as they relate to the 
educational assessment of minority students. 

'4. identify two sources of information about a student's functioning in 
educational settings. ' 

5. Identify two factors to be considered when making Informal decisions 
about a student's educational functioning.' 

6. Identify the major comp^ents of a systematic assessment procedure. 

7. Identify two sources of inconsistency or. error in methods of gathering 

t 

, assessment information about a student, 

8. Detcribe the nature of the information that can be gathered from 
achievement tests. 

9. Identify two factors that can negatively influence the validity of a 
test. 

\ 

\ 

10. What are some purposes of educational assessment? 

11. What is the difference in the nature of information obtained from a 
« > 

norm- referenced test and a criterion-referenced test? 

12. Describe domain- referenced testing. 

13. What are five major considerations in setting a criterion for a 

student's performance? , ^ 

4 • * , 
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14. State two areas which are of concern when evaluating treatment 
effectiveness. 

15. Define treatment validity. 

16. What are the three mandates laid down in Public Law 94^T4^that relate 
to the interpretation and communication o'f assessment information? 

In front of the next 11 items, place a "T" if you think the statement is \ 
true, or an "F" if you think the statement is false. 

1. Tests are either "good" pr "bad." Poor' programming is the result of 

♦ 

using "bad" tests. 



2. The purpose -of assessment is to prescribe a fixed treatment -that con- 

tinues\ until a cure is achieved. 
* 3: The requirements of Public Law 94-142 necessitate a comprehensive approach 

to assessment team membership and to instrumentation. 
4: School psychologists caq^be most useful by confining their ac^^ties to 

the administration of standardized tests of ability and achievement. 

5. When placement decisions for a student are made, information" from norm- 
referenced tests provides the most comprehensive data-base. 

6. Information obtained from a student's parents can assist in verifying 
information given by the referring teacher. 

7. Students' achievement test scores reflect both' their ability anj,the r% 

instructional effectiveness of their educational program. 

J 8. Human error is a minor* source of inconsistency in the assessment process 

and compensations for unreliability can easily be made. 
9. It is the responsibility of the test developer to ensure test validity. 
Ory;e this has been demonstrated, the professional need have no concerns 
about using the test. 

- 1 . -8- 
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An advantage in using norm- referenced tests is their adaptability to 
a( specific curriculum sequence- 

. . v ■ . ... 

To be of maximum use to the teacher, criterion- referenced testing 
must be integrated into the day-by-day functioning of the classroom 
and must not be separated out as a "testing" activity. 




■ f 
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. V The testing Debate 

The role of psychometric testing within the educational system has long been 
debated. A view of testing asfa; sorting procedure which results in students be- 
ing divided into those who will succeeded those who will not is common. Test- 
ing is sometimes considered a tool for social decision-making about the futures 
,of millions of children (Burton, 1978). Such decision-making, in ttf o many cases, 
has resulted in inappropriate placement of children in educational programs and 
curricula, with life-^ong deleterious effects. It has also been noted that inap- 
propriate decisions seem to occur more frequently among certain minority groups, 
and this has been seen, at least in part, as a result of "placement decisions 
based on culturally biased psychological tests (Larry P. vsVRiles ,YI979 ; Mercer, 
1973). 

In the testing debate, antagonists cite not only political and social abuses 
of testing (Kamin, 1975), but also, testing devices that are technically inade- , 
quate, are normed on populations which bear no resemblance to the pupils being 
tested, or inadequately sample the behaviors that the instrument supposedly 
tests (Salvia & Ysseldyke, 1978). Adelman and Taylor (1979) present several 
conceptual, methodological and ethical assessment issues^which merit discussion. 

Key Conceptual, Methodological, and Ethical Assessment Issues 
A. Conceptual 

x Current practices reflect a rather inadequate .appreciation of the' 
following matters: " . . " • 

1. Whose interests are and should be served by the assessment activity 
(e.g., the ^society, the client, the intervener)? 

2. Who sets criteria determining assessee status, need?, problems, and 
progress? 



... . . f 

3. Who decides on whose interests should be* served and oh who is to set 

/ 1 » . 

'criteria? 

* 

... >. ' 

4. What are the various tasks which currently ^are subsumed under the term 

"assessment diagnosis"? * 

5. What are the limitations in perspective of the models of pause and 
correction upon which current activity is based? * 

6. What are the assessor biasing factors iwhich need to be systematically 

*■ 

accounted for in assessment activity? 

7. What are the assesseegjgotivationaT^and developmental factors which 
need to be systematically accounted for in assessment activity? 

B. Methodological ( technical , practical ) ; 

While widely acknowledged, the following problems continue to-place major 
£ limitations on assessment activity: 

1. The more complex the assessment objectives, the lower the reliability 
of tha^otal set of measurement * procedures . 

2. Construct'validity often has -not been demonstrated satisfactorily by 
scientific standards, e.g. , the "validation" procedures, when under- 
taken, often are tautological. . * 4 

3. Predictive and postdictive validity appears to diminish, in some 
instances at an exponential rate, the more distant in time the assess- 
ment data being gathered are from the criterion being predicted to 
(or from the original factor causing the behavior under investigation) 

4. There is a sparsity of /systematically gathered and agreed-upon norms 
and standards for making judgments ("good-bad," "normal -abnormal ," 
"success-failure") thereby resulting in idiosyncratic variations on 
judgments which are often beyond accountability. 

• . . , -11- 



5. The utility of a procedure may be judged as mucty (or more) on the 
basis of its marketability and the current absence of a feasible 
alternative, as on its efficacy, (e.g. , its validity with regard to 
the decisions being made, its ability to add information beyond 
base rate levels). 

6. The costs of assessment practices are' escalating; time demands often 
are extensive; referral practices tend to overrely on "old net- 
works, etc. x ■' 

Ethical • \ . 

Ethical practices reflect inadequate efforts to systematically detect 

and minimize the following iatrogenic effects: 

1. Misidentification of the cause of a problem ('.e.g., false negatives 
and positives such as those resulting from over- reliance on person- 

ft 

focused tests and observer-assessor biases). 

> o 

2. Misprescriptions related to subsequent intervention procedures. 

3. Violations of rights (e.g., failure to get truly informed consent, 
invasion of privacy, denial of access to assessment reports and of 
the right to correct the record). 

4. Negative repercussions of assessment .processes or products (e.g., 
increasing feelings of anxiety, incompetenc^y^and lack of self-deter- 
mination, increasing over- reliance and dependency on professionals, 
initiating self-fulfilling prophecies and stigmatizing effects). 

5. Failure to pursue^professional responsibility with regard to improving 
standards of practice and advancing knowledge^ (including collusion 
with an inadequate status qdo). „ 

Note. From "Initial psychoeducational assessment and related consultation," 

J' N . 

by H. S. Adelman and L. Taylor, Learning Disability Quarterly , 1979, 2, 52-64 

-12- .. 



Clarification of the Issues 

. .. Com i delation' of the following three points may help clarify these testing 

issues: ~ 1 

1. The concentration on the abuses that have otcurred in psychoeducational 
assessment may blur tfie distinction between tests and the decisions' made from 
test data. Many abuses occur because of ignorance or joverzealousness on the 
part of the diagnostician or decision-make^ Tests aVe not necessarily "good" 
or "bad"; such value judgments can be reserved for evaluating how test results 

.are used in screening,, placement, program planning, and evaluation of individual 

♦ 

pupil progress. \ • 

2. Testing \| but one method of assessing a child and is only one tool 

to use in making educational decisions. Educational personnel who fail to make 
use of such techniques as the interview, observation, and environmental analysis 
as well as their own professional judgment have gathered inadequate information 
to make sound educational decisions (Shertzer & Linden, 1979). 

3. "The process of assessment is a constructive. . .flexible, continuous 
process, leading not, to a fixed prescription of treatment until a cure is 
achieved, but to an ongoing program which may frequently be modified in the 
interests of the student's life situation and of a reduction in his current 
specific difficulties." (Clarke & Clarke, 1975) 

The Educational Role of Professionals and PL 94-142 
Individual roles and responsibilities of professionals in educational 
settings are, of course, largely determined by the nature of their professional 
training. This factor, as well as the institutionalization of specialized 
roles, has often led to a compartmental ization of responsibilities. In effect, 



V. 

this compartmentalization has created a view of the child as a group of separate 



and unique entities. But the practices which have i^esul ted from such narrow 
perspectives are no longer feasible under Public Law 94-142, which, requires that 
a student's individual education program be "developed by a team consisting of 
the child's teacher, a person other than a teacher who is qualified to provide 
or supervise the provision pT special education, one or both parents, the child 
(when appropriate), and other persons who are brought in at the discretion of 
the scfiooV." The purpose of the IEP is to provide an overall, program of special 
education /and related -services and it 'should include a justification for those 
services and placement. In addition, the IEP must include the objective criteria 
that will be used to evaluate the child's achievement. A mul ti disciplinary 
assessment tea,m and multiple assessment methods are necessary. 

Traditional Psychoeducational Assessment . 

Traditionally, roles involving the assessment of children have often re- 
stricted school personnel to the administration of standardized tests of ability 
and achievement. Information from these tests was used to predict a student'^ 
success or failure during school and in later life. Diagnosis of a student's ' 
abilities or deficits was often confined to norm- referenced statements based 
on composite scores and often had few direct implications for instructional in- 
tervention. Such diagnostic practices were enlisted to support special educa- 
tion practices of classification according to handicap for the purposes of 
placement, and for making claims t for federal /fundi ng, bat told little about what 
type of educational plans should be designed for students diagnosed as evidenc- 
ing any one of several handicapping conditions. But these traditional assessment 
practices are rapidly changing. 

-14- 
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Reynolds (1975) has called attention to*changes in special education that 

are ,a1>so effecting changes^in assessment practices. He states: 

We are in a zero-demission era: consequently, schools requi/e a 
• decision orientation other than simple prediction; they neett one 
that is Oriented to individual rather than institutional payoff. 
V In today's context' the measurement technologies ought to become 
integral parts of instruction designed to make a difference in 
the lives of children and not just a prediction about their 
lives, (p. 15) ■ 

Cognitive Entry Characteristics 

In selecting assessment .procedures that will make a difference, the follow- 

ing observation regarding "cognitive entry characteristics" is appropriate :<* 

Quite in contrast to intel 1 igence' and aptitude indices are' cogni- 
five entry characteristics . These are the specific knowledge, / 
abilities, or skills that are essential for the learning of a 
particular school or a particular learning task. Such prerequi- 
sites typically correlate +.70 or higher, with measures of achieve- 
ment in a subject i Furthermtire, when they are identified and 
measured, they replace intelligence and aptitude- tests in the 
prediction of later achievement. That is, intelligence or aptitude 
tests add little or nothing to cognitive entry measures for the 
prediction of school learning. All of this is to say that cogni- 
tive entry characteristics have a high relationship to achievement^ 
and they have an obvious causal effect on later achievement. This 
is especially true where sequential learning tasks are involved 
where it may be impossible to learn tils k B without prior adequate 
learning of task A. (Bloom, 1980) 

This distinction between intelligence and aptitude tests and specific 
knowledge and skill tests may be very important for special education popula- 
tions where the predictive value of intelligence and aptitude tests is lessened 

4 

by the variability within handicapped groups and the small percentage of handi- 
capped individuals included in population samples used to develop test norms. 

The comparative predictive value of different types of test information 
was graphically demonstrated in a study by Hofmeister and Espeseth (1970). . 
This study investigated the effectiveness of measures of mental age (Stanford- 

■ -15- - 
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Binet), language age (Illinois Test of Psychol inguis tic Abilities) and reading 
achievement- (Wide-Range Achievement Test) as predictors of progress with^a 
population of moderately retarded youth in a selected reading program. The 
predictive coefficients were: -.11 for mental age; +.11 for language age, and 
+.78 for the reading achievement test. The discriminating item in tfie. reading 
test responsible for identifying "successful readers was the letter naming item. 
In essence 'then, a two-minute test of a student's skill in attaching names to 
letters was found to be far more useful for assessing a students ability to 
participate in a specific 'reading program than the estimates of mental age or 
language a>ge. Hofmeister and Espeseth concluded that: 

*• ■ ■ v 

...variables such as MA and LA, which are often thought of as 
psychological correlates of reading ability, were comparatively 
ineffective as predictors of reading achievement with the group 
observed in this study. The results also suggested that it 
might be more profitable to look at task oriented variables 
which are concerned with determining the position of the indi- 
vidual in the learning sequence, (p. 107) , 

PL 94-142 and Nondiscriminatory Evaluation * 

In order to ensure appropriate educational placement, equality of educa- 
tional Opportunity, and the right to ethnic dignity and respect, and to prevent 
unfair stigmatizing of students, the Education for All Handicapped Children Act 
of 1975 (PL 94-142) mandates the following assessment procedures: 

The testing and evaluation materials and procedures will be 
selected and administered so as not to be culturally discrimina- 
tory. 

Such materials and procedures are to be provided in the child's 
native language or mode of communication. 

No single procedure or test can be the sole criterion for deter- 
mining the appropriate education program for the child (Section 
612). 



Under PL 94-142 » it is the pupil needs . and not a district-wide testing 
program that determines the instrument and associated assessment processes. 
The following examples sample some of the diversity of assessment practices 
possible under 94-142. . * 

1. You have to assess a ijj-year old in a vocational program. 
Suggestion : You might review "The Assessment of Applied Aca- 
demic and Social Skills," (Forness, Thornton, & Horton, 1981)/ 
See th.is article in the appendix. 

2. A parent revests an evaluation of her 17-year old son's writing 
, skills. Suggestion : James A. Poteet's "Checklist of Written 

Expression" would be a practical instrument that would provide 
a series of specific short-term objectives for an IEP goal in 
this area. See this article in the appendix. 

3. The parent of a severely handicapped child expresses interest in 
establishing an IEP goal on leisure skills. Suggestion : Wehman 
and Schleien's (1980) suggestions for thj) "Assessment and Selection 

t of Leisure Skills for Severely Handicapped Individuals" would be 

appropriate for this assessment assignment. See this article in 
the appendix. 

* 

- Assessment Methodology 
Educational assessment is a miiltifaceted and systematic process carried 
out for the purpose of making decisions about the performance of students in 
their current school setting. Assessment is more than testing. It is the 
systematic process of using information from all possible sources in order to 
make educational decisions about students. A systematic approach to educational 
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assessment is one in which a variety of assessment methods are used and in which 
all relevant assessment variables are considered. " * 

Asse ssment Methods 

Information about a child's functioning in educational settings may be 
gathered through: 

1. Inspection of the child's record files . Information reported in cumula 
tive and other available records can be h&lpful in determining if there are fac- 
tors that might account for problems the child is having, if there are trends 
in the growth of the problem, and if there are other relevant factors that need 
to be evaluated. r 
ji 2. Informal consultation with others who know the ch ild. Consultation 
with persons who know the child well (e.g., peers, siblings, p.arents) will lead 
to a more comprehensive assessment. 

3. Structured interviews . Interviews with the parent, the student and 
Wchool personnel can yield information about the student's areas of difficulty 

and determine what resources have been previously employed in working with the 
student , s - ( 

4. Observation . Through observation, assessment data is collected, on the 
behavior of the student as it occurs naturally in the environment. Such data 
can focus on specific facets of behavior (e.g., student-teacher interaction), 
can indicate areas in need of further evaluation, can confirm other information 
gleaned from records, and can provide insights that may lead to an improved 

' program for the student. Observations may be formal or informal and include 
anecdotal records, interaction analysis, checklists, and rating scales. Obser- 
yation procedures can be both long-term and short-term processes. 

-18- 
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5. Norm- referenced tests . Standardf zed tests can be used for both screen- 
ing and diagnostic purposes to determine how one child compares with other children 

6. Criterion-referenced tests . This type of test measures a child's level 

■ 1 ! : - 

of skill development in a particular area. It is' especial ly useful for planning 
purposes because criterion statements can be used as goals and short-term objec- 
tives ,for instruction. 

Relevant Assessment Variables 
Educational decision-makers should gather educational information about 
the "whole" child. They should therefore consider all relevant factors which, 
because of their interactions with the child, may influence the child's func- 
tioning. These factors will vary with the child and the particular educational 
problem, but should include: 

1. CI ass room envi ronment . The classroom environment refers to the physical 
arrangement of objects within the classroom (seating arrangements, materials, 
learning centers, etc.) which have the potential to impact learning, social in- 
teraction patterns, time on-task, interests, achievement levels, etc. 

2. Curriculum .' A thorough knowledge of the curriculum presented to the 
child is necessary when making decisions about that -child's educational function- 
ing. Assessors should.be aware of: 

a. conceptual level and sequence of student activities; 

b. number of academic tasks and task sequences; 

c. evaluation methods used in classroom; 

d. variety and levels of, instructional materials; 

e. appropriateness of curriculum and materials for the child. 

3. Instructional behavior > Teacher behavior is the unifying factor 

■ ~ — — — x 

which brings the environment and the curriculum together to impact on the child. 

-19- 
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To be effective, assessment processes must be conducted so that specific reme- 
dies expressed in changes in instructional oehavior can be generated^ 
Engelmann, G^nzin and Severson (1979) observed that 

.... the teacher achieves behavioral change only by (manipulating 
environmental events. This point is extremely important. It 
follows that the remedy must cle"arly a imply manipulation of those 
environmental events. It must tell teachers what they are doing 
wrong and what types of different teaching behaviors/ they should 
implement. The remedy must be specific and concrete- because teach- 
f ing always involves specific and concrete acts. (f/. 356) 

tihen making decisions about the functioning\-of students in educational 
settings, it is important to copsider the three factors listed above. However, 
the primary focus during the assessment process should be on the pupil's prob- 
lems and remedies that can be implemented with the| available resources. 

Several models have been developed for systematic educational assessment. 
Underlying all models is the movement of decision-makers from information which 
is general , broad, and only assumed to be accurate, to information which is 
specific, precise, and valid. The purpose of gaining valid information through 
the^assessment procedure is twofold? First, professionals must be in a position 
to make valid intervention decisions about a pupil with special needs. Second, 
the assessment infbrmation ©btained must provide the basis for an evaluation of 
the success of any interventions that are implemented. 

In the following section, an example of a systematic assessment model is 
presented. Assessment methods and sources of information^a^out the child are 
integrated into an assessment procedure. The procedure outlined is one which 
might be followed in an interdisciplinary evaluation process. However, it cer- 
tainly is the case that many of the procedures described may be used to advan- 
tage by school personnel outside the formal assessment process. 
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A Model for Systematic Assessment 

Screening 

Referral and verification. The referral process is the first step in 

i 

assuring the appropriate programming of children with suspected special educa- 
" tional needs. Referrals are typically «^iti a ted by counselors, psychologists, 
classroom teachers or resource teachers, but, may be initiated by others, includ-~ 
ing the students themselves, or their parents. Information leading to the veVi- 
fication of educational problems for which a student has been referred can come 
from examination of^fche student's cumulative records and direct .observation of 
the student's behaviors. Data on the student's personal, medical and educational 
history from cumulative records can contribute to referral information and allow 
educational personnel to discern the pattern of events leading up tQ the present 
situation. Observations can provide comprehensive, detailed, and specific in- 
formation about the behavior of y/e s tudent and about the contexts or environ- 
ments in which the observations are made. Much of the direct observation can 
be carried out by teachers. ' In fact, data collected by teachers before the for- 
mal assessment process is initiated often suggests possible solutions to the 
present problem, or that the student's behavior does not substantially deviate 
from that of other class members (see "Formal Observation of Students' Social 
Behavior", by F. Wood, in this series). 

In observing the student in interactions, the focus should be on the iden- 
tification of habitually-occurring events which reinforce the behavior being 

* 

studied. Both^social and nonsocial consequences which maintain the behavior 
must be identified, and an estimate of the "Student's responses to such stimuli 
should be made. It should also be possible to identify means of structuring 
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the environment in the future. Once educational problems and target behaviors 
for the student have been identified, environmental contingencies which w,ill 
reinforce the target behaviors can be determined. 

One method of collecting the information outlined above is through a 
behavioral interview. While the behavioral interview is* probably one of the 
least structured assessment strategies, it can nevertheless support the more 
objective data gathered through systematic observation. The following outline 
is suggested to ensure that all possible information is collected from the in- 
dividual and that data relevant to the formulation of an achievement plan is 
gathered. 

1. An initial- analysis of the problem situation should be made, in which 

\ « 
* ■ 1 

problematic behavioral excesses and deficits as well as nonproblematic behavioral 

Assets are specified. 

2.. The problem situation should be clarified hy identifying the individuals 
who object to the problem behavior and who niay be affected by any behavior change 
made by the student. The clarification should also help to specify the condi- 
tions under which the behavior occurs. 

3. A motivational analysis should be carried out in which re'inforcers 
(both positive and negative) that may be maintaining the problem behaviors, or- 
that may be useful in shaping more appropriate behaviors, are specified. 

4. A developmental analysis should be made in which several questions are 
raised about the biological, sociological, and behavioral changes that may be 
pertinent to the problem behavior. 

5. ^ An analysis of the student's self-control should be completed, in which 
the limitations, conditions, and methods of self-control are defined. | 

6. Social relationships sfcould be identified and the influence of signifi- 
cant others on the student specified. 
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7. The student's social, cultural, and physical environments should be 
examined with consideration of cultural norms relating to the problem behavior, 
the similarity of norms in different settings, and various environmental restraints 
impinging on the student. 

Schertzer and Linden (1979) recommend that information be obtained from, 
significant others in the students' lives, e.g., parents and school personnel. 
These second-party reports help in obtaining information about the student's 
likes and dislikes (objects, events, places, activities, people, etc. ) , and in 
identifying the perceptions of school personnel and parents as to the nature of 

the problem they see with the child. In addition, assessment instruments which 

y > 

structure the perceptions of these significant others, such as the American 
Association on Mental Deficiency Adaptive Behavior Scale (AAMD, 1974) or the 
Devereaux Elementary School Behavior Profile (Spivack & Swift, 1967), can assist 
in the gathering of second-party report information. 

Appropriate screening procedures also require that information from previous 
assessments of the student's performance on standardized tests of general verbal 

•i 

and nonverbal ability (such as intelligence tests) and standardized educational 
achievement tests (such as reading, spelling, and math) be examined. 

Standardized achievement test data . Achievement tests are devices that 
assess a student's skilT development in academic content areas. < Most tests 
are commercial instruments that sample the products of assumed past formal and 

informal educational experiences and measure the extent to which an individual 

• . . ■ . \ 

has profited from schooling and/or lif§. experiences as compared to others of 

the same age or grade. The scores assigned to a pupil reflect both pupil abili- 
ty and the instructional effectiveness of the educational program. When using 
information from achievement tests, the assessor must be aware (a) of the nature 



of behaviors sampled by the test, particularly the relationship of specific 
curricula in use in the school district; (b) wffat ^specific items- the student 
has passed and failed, and consistent failure patterns; ^1d„(c) that in the 

screening procedure, achievement tests determine,, in a global way, only the 

' . .. ' 

child's current level of functioning. 

Standardized achievement tests, such as the Stanford Achievement Test and 

« . * 

the Iowa Test of Basic Skills are often used as screening devices. These tests 
in fact measure the extent to. which a student has benefited' from past schooling, 

compared to others of the same age or grade level,. Knowing the nature of the 

\ 

subtests in these batteries allows some information to be obtained about the 
remediation needed by individual students and provides a general idea about where 
to start additional diagnostic assessment. 

Evaluation of Screening Data and Planning Interventions ' 

In this step, school- personnel evaluate the screening data and their 
reliability. It is important to be aware of the factors influencing reliability 
and validity of observation and test information. 

Information gained from interviews will vary among interviewees, and these 
inconsistencies mean that all interpretations must be viewed as tentative hypothe- 
ses to be verified or refuted with further evidence. For example^ interview 
data from a teacher with limited observational, ski 1 Is who has not ^systematically 

a 

collected data, or is hoping to have a difficult child removed to a'separate 
special education class* will often be unreliable and biased and may'be of little 
use in the assessment process. 

Observational tools must be used with care and precision. Misinterpretation 
and misuse of observational techniques will distort estimates of individual be- ' t 
havior patterns which are at best only samples of behavior. Interpretation of 
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information must include attention to potential problems of sampling error and. 
of inadequate sampling. Observer bias and the possibility of the individual's 
awareness of being observed, in conjunction with the variability of behavior 
and the selectivity of observation, are threats to the validity and reliability 
of observational tools and techniques. 

The direct observation of the pupil in instructional settings is one way 
to correct two common weaknesses in assessment practices, namely, the lack of 
emphasis on alterable variable^ and the implicit assumption that the child is 
always the problem. Too of ten. assessment practices allocate extensive resources 
to collecting data on variables that cannot be manipulated to help the pupil. 
This might occur by collecting extensive data on community ^nd home variables 
that cannot be altered with the resources available to the school. A similar 
problem occurs with the assessment of some school-related behaviors. For example 
the assessment of some categories of perceptual -motor abilities presents a prob- 
lem because the etiological relationship with academic skills is .unclear and 
the research suggests that our procedures for ^'training" these abilities are . 
generally ineffective (Kavale & Mattson, 1980).* 

The direct observation of pupils in instructional settings allows for the 
collection of information on instructor behavior which may be an important part 
of the problem. Variables such as instructional methods* instructional materials 

t 

classroom organization, teacher feedback and reinforcement practices are all 

j » 

s 

important variables that can be changed. 

General izability of Observational Data * 

Too often observational -data lacks validity because of incomplete sampling 
practices. "Collection of observational data in high school programs presents 
obvious problems because of the fragmentation of curriculum and instructional 
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supervision. Data collected in one subject matter area may have limited value 
in making generalizations to other subject matter areas and other teachers. 

Even with the same teacher, several observations across several lessons 
may be necessary to achieve acceptable 'levels of general izability. Capie (1981) 
found that in observing students.' on-task behavior, 20 observations in each of 
five lessons were necessary to achieve a general i zabi 1 ity coefficient of .80 (a 
generally accepted, level of instrument reliability), Capie noted that to en- 
"s'urTl^TTa^TTTty "oT'tnV^s^f^tTohal samples "the .number of lessons observed 
is^/ar more important than the amount of observations within lessons." (p. 18) 

Factors affecting test validity . Whether to use a test for a certain pur-' 
pose and hoW to interpret the information yielded by the test are decisions which 
should be governed by the validity of the test. Validity is specific both to 
purpose and population. Despite efforts of test developers to ensure content, 

« 

construct, and predictive ^validity, tests are only valid for certain purposes. 
Selection of standardized tests must be made with the purpose of the test in 
mind. These questions should be considered: v 

V Was the test designed to be used for screening purposes? 

2. Was the test designed to be used to place a student in a specific 
curriculum? 

3. Was the test designed to be used to assist teachers and administrators 
in planning individual or group educational programs? 

4. Was the test designed to be used for program evaluation? 

5. Was the test designed to be used to assess individual progress? 
On another level, and related to the question of validity, are questions 

that must be asked to determine the accuracy of information yielded by the 
test: 
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1. Was the test technically adequate\ that is, did ft s'pecify adequate 
information about test administration, standardization, reliability and validity? 

2. Assuming that the test was technically adequate, was it used for the 
right purpose? For example, was a measure of receptive vocabulary, such as the 
Peabody Vocabulary Test, used as a measure of intelligence? 

3. Assuming that the test was technically adequate, was it appropriate to 
the child?i Did the student come from a cultural group comparable to those in 
the norming sample? Was the test age-appropriate? Did the child possess physi- 
cal and mental characteristics comparable to those in the norming sample? Did 
the test require responses that a child with motor, visual, or hearing impair- 
ments would be unable to perform? Was the tester aware of any medication the 
child was taking? Many drugs, such as Mellaril, Dilantin, Valium, or Ritalin 
may affect test results by influencing the nature and rate of responses (Wysocki , 
Fuqua, Davis, & Breuning, 1981). , . 

4. Is the assumption being made that norm-referenced r scores such as grade 
and age equivalents, or composite scores such as IQ or Social Quotient (SQ), are,< 
giving adequate representations of skills- and deficiencies? | 

5. What information does the tester have about the child's background anoS 
current status and performance that will assist in accurate interpretation of 
test scores? A . » . 

6. What relationship exists between the test and the curriculum in which 

the student is. currently placed? Is the test measuring knowledge (and the -chance 

\ 

to acquire it) or is it measuring variables that may not be in the student's 
repertoire of learned/behavior? , 

If these questions cannot be responded to adequately, the test information 
must be interpreted with caution. In such cases, more appropriate assessment 



* V 

V 

is necessary * to provide an accurate picture of the student's abilities and 
deficiencies so that an appropriate and relevant program can be developed. 

Intervention • f 

The purpose of an educational assessment is to provide: (1) recommendations 
for instructional and behavioral goals and objectives, (2) recommendations for 
educational placement^ (3) measures of students 1 present skills, (4) measures 
of students' progress toward established goals and objectives, and (5) evalua- 
tions of the effectiveness of students' educational programs. In the following 
section, some methods for using assessment information for these purposes will 
be presented. 

■\ ■ ** 

Acti vi ties . 

Investigate the assessment procedures used in a school. To what extent 
are decisions based on standardized and achievement tests? To what extent are 
data related to a student's actual behavior and specific skills used in the 
assessment? • * 

* Plan to spend 30 minutes with a child. For 15 minutes ask the child 
questions from a standard psychological test (e.g., WISC-R, Stanford-Binet , 
ITPA), and for the other 15 minutes have the student answer problems from a 
personally constructed, sequenced list of arithmetic problems. Compare the 
usefulness of the two assessment procedures in making statements about the 
child's educational abilities and needs. v 

V 

Y 
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NomwReferenced and Criterion-Referenced Assessment 

* 

Quality educational programming requires that assessment instruments be 
used to ensure' that each pupil enters a curriculum with the necessary prerequi- 
site skills. A testing technology has been developed that is concerned with 
defining the relationship between an individual's skills and instructional se- 
qudfices. Glaser (1963) in an article on the measurement of Jearning, defined 

I : . -,. . 7 ■ « u - - 
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two types of tests. One type, the norm- referenced test, evaluates the child's 
performance by comparison with that of the other children. The intelligence 
test is a classic norm-referenced test, the other type, the criterion- referenced 
test, evaluates the child in terms of some learning task at some absolute stand- 
ard that is independent of other children's performances. The criterion- / 
referenced test is designed to identify the relationship between a pupil and 
a specific instructional task. If a teacher wants toHoiow what types of number- 
tasks a child has mastered, then a criterion-referenced test would generally be 
called for. 

Although a test is usually constructed as either norm- referenced or 
criterion- referenced, a person may use one test for both purposes. If we were 
to examine the items on a standardized achievement test for patterns of suc- 
cesses or failures on specific instructional tasks, we would be using it as a 
criterion -referenced test. If we used a test developed as criterion -referenced 
to rank the pupils in a class, we would be using it as a norm- referenced test 
because the child's score (rank) would describe him in terms of his relationship 
with others (the rest of the pupils in the class). 

Normative Testing and Instruction 

The need to develop Individualized Education Programs (IEPs) for special 



education pupils requires reconsideration of the role of ^ norm- referenced testing 
procedures. Normative tests are typically designed for such purposes as predicr 

on, selection, and comparison. Special education has a long history of at- 
tempting to adapt these tests for individualized instruction. However, exbpt 
for a few standardized diagnostic tests which have both norm- referenced and 
criterion- referenced properties, the majority of norm- re fere need tests provide 
liijnted information for guiding the teaching of specific ski 1-1 - A major prob- 
lem encountered in the use of nornj-referenced tests is that most are not de- 
signed to relate directly to a specific curriculum sequence.? The discrepancies 



between norm- referenced and criterion-referenced test information become espe- 
cially important when using such information for individual program planning. 



Tu)o Types of Testing, •Compared 



Norm-R e ferenced 

0 Evaluates individual per- 
formance in comparison to 
a group of persons. \ 

0 Is used to evaluate a ' 
student as ff below grade 
level," "at grade level, " 
or "above grade level. " 

0 Fails to indicate where 
students have mastered 
the spectrum of instruc- 
tional objectives.' 

0 Generally poor aides in 
planning specific instruc- 
tional programs. 

0 Is often vague in relation 
to instructional content. 

0 Does not operationally 
define mastery and/or 
success* 

0 Applies poorly to the 
individualization of 
ins truction. 



Cri terion-Referenced 

0 Evaluates individual performance 
in relation to <x fixed standard. 

0 Not concerned with grade level 
descriptions . 



0 Identifies the individuals who 
have mastered the spectrum of 
instructional objectives. 

0 Geared to provide information 
to be used in planning instruc- 
tion* 

0 Is content specific. 

* 

0 Operationally defines mastery 
and/or success. * 

•> 

0 Applies directly to the individu- 
alization "of instruction. 
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# Is not concerned .with task # Depends upon task analysis, 
analysis. 

# Test results interpreted • Test results interpreted in 

in reference to a person's reference to a person's position 

position in relation to^the in relation to the curriculum, 
scores of others. 

'"—adapted from Housden } J. L. 3 & LeGear, L. An emerging model: 
Criterion-Referenced -evaluation. Thrust, April 1973. 



In the example- in Table 1 , data were collected from twenty-four pupils 
referred for special education services as spelling failures. Two types of 
test data were collected: (a) norm-referenced data from a standardized test, 
and (b) data from a criterion-referenced test that identified the placement of 
a child with regard to the specific spelling curriculum in use in tKe school. 
Generally, a criterion-referenced test is not used to identify grade levels 
because this usually entails moving from specific practical/information to 
more generaTlmd less ^ prescriptive iTiformati on. For purposes of comparison in 
this case, however, a grade level score was assigned to the criterion-referenced 
data. This grade level score indicated the level infthe curriculum set for that 
grade at which instruction should begin." An observation of /the scores in 
Table i reveals that the difference between the overall mean grade level scores 

r 

on the two tests was not great (0.14). However, when the pupils*"are considered 
as individuals, relation|hips between normative scores (standardized achievement 
test) and criterion tests (curriculum placement test) are soygreat that the 
rather common practice of using standardized achievement test data for individual 
program planning must be questioned. In analyzing the content of the two tests, 
it was found th,at the criterion-referenced test content was consistent with the 
specific spelling program in use in the school, which placed a strong emphasis 
on controlled sequences built around the phonetic structures of words . In this 



Table 1 
SPELLING FAILURE REFERRALS 
Norm- Referenced Score--Curriculum Placement 



Grade 



N = 6 



Ach, Test Score* 
(Norm- referenced) 



Curr. Placement* 
(Crit. -referenced) 



Differences 
in Placement* 



1.1 

2.0 
2.0 
1.7 
1.7 
1.4 



2. 
2. 
2. 
2. 

2. 
2. 



,9 
,2 
.2 
.3 
.3 
.8 



X = -.45** 



Grade 
4 

N = 6 



1.8 
1.8 
2.1 
1.5 
1.5 
2.9 



2.2 
2,0 
2.2 
2.2 
2.0 
2.2 



4 

2 
1 

7 
7 
7 



X = -.23** 



Grade 
5 

N = 6 



3.2 
3.2 
3.2 
3.4 
3.2 
1.9 



2.8 
2.2 
2.2 
2.2 
2.8 
2.6 



+ .4 
+1.0 
+1.0 
+1.2 
+ .4 
- .7 



X = ,>55** 



Grade 
6 

N = 6 



4. 
2. 
2. 
4. 
4. 
2. 



3.4 
2.8 
3.4 
2.8 
2.6 
2.8 



+1.1 
+ .1 

- .5 
+1.2 
+2.2 
+ .1 



X = .68** 



Total number of subjects = 24 
Difference between means - .14 
Correlation between normative and 
criterion- referenced test scores = .65 

*A11 scores expressed in grade levels 
**Positive score indicates normative test higher 
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instructional program, irregular words were emphasized much later than they are 
in some other types of spelling programs that use different theoretical ration- 
ales such as "frequency of use." The content of the standardized achievement 
test stressed irregular words much earlier than did the criterion -referenced 
test; it was, therefore, of little value for making decisions related to the 
phonetically oriented curriculum being used for the twenty-four children listed 
in Table l.f Thus, itis important to choose tests that relate to the curricu- 
lum being used in drder to obtain accurate data in developing the child's" in- 
dividual program. 



The Process of Diagnosis 

t The process of diagnosis in an instructional setting has been 
likened by some to the medical process fronuwhich the term has its 
roots (i.e., a doctor examines the patient's symptoms and the pat- 
tern of these symptoms leads him to the diagnosis that a certain 
disease of dysfunction is present). 
j ■ - 

This analogy is spurious, however, for it implies that the 
learning diagnosis identifies or defines a knowledge "disease" or 
a disorder rather than a specific need or a cluster of needs, 
which is what actually takes place. Diagnosis in education, then, 
is actually a needs assessment process . 

The instructional manager uses his professional skills and 
the instruments and techniques available to him to examine the 
present state of the learner in relation to ppt^established 
learning outcomes or objectives, usually arrajed in a continuum 
or hierarchy of progression (Hickey & Hoffman, 1973, p. 35). 



Diagnostic Devices 

There are a number of standardized diagnostic tests avail^le tn at have 
both norm- referenced and cri ter ion- referenced properties. Many standardized 
di agnostic tests can tell the teacher whether a child is above or below average 
for his chronological age in the area tested, and in sub-areas thalPmake up the 
general area. These tests also have some value for program evt^jkRvtion, since 



they demonstrate student achievement particularly if accountability data are 
required in simple, readily understood terms. Thejr. weakness in this regard 
is, of course, that student achievement is directly tied to the content of in- 
struction and measured progress is highly influenced by the congruence between 
test and curriculum. 

In many settings where quality student assessment procedures exist, broad 
standardized tests are used in combination with criterion- referenced tests that 
are more specific to the local curriculum and associated materials. A stand- 
ardized diagnostic math test might indicate that a child is weak in addition 
combinations, but a more specific instrument will be needed to determine which 
addition combinations need to be taught to the child. 

The skills assessed by diagnostic reading tests include those of oral 
reading, comprehension, word attack, word recognition, and rate of reading. 
Tests commonly used are the Gray Oral Reading Test, Gates-McKillop Reading 
Diagnostic Tests, Durrell Analysis of Reading Difficulty, Stanford Diagnostic 
Reading Test, and the Woodcock Reading Mastery Test. Another approach is exem- 
plified by the Fountain Valley Support System in Reading, a criterion-referenced 
testing system. The Fountain Valley system includes pupil profiles which provide 
.a record of individual pupil achievement and facilitates the monitoring of pupil 

progress . . # 

Diagnostic assessment in mathematics leads to specific information about a 

student's performance in content areas (e.g., numeration, fractions, algebra) 

operations, and applications (e.g., measurement, time, problem-solving, money). 

% 

Three most commonly Used diagnostic! mathematics tests are the Key Math Diagnos- 
tic Arithmetic Test, the Stanford Diagnostic Mathematics Test and Diagnosis: 
An Instructional Aid in Mathematics. 
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Criterion-Referenced Tests 

' ■ ■ :— ■ f ■ — ; ■ — t r 

The quality of a criterion-referenced test depends on the degree to which 
a skil^ area is clearly identified and represented witfrin the test. Some cri- 
terion-referenced tests are poorly constructed. In recognition of this fact, 
Hively (1974) coined the term "domain-referenced. 11 A domain-referenced test 
is one in which the emphasis is placed on precisely identifying skill areas 
(domains). The test items of a domain ^referenced test are selected so that one 

can be certain that a child who meets criteria on the jtems which represent a 

It 

domain would be able to master all other possible items of the domain when they 

I 

were encountered. For example, if a series of test items was prepared to test 

a child's mastery of a domain, such as long division of decimal fractions using 

single digit divisors., the test items would have to include examples with zero 

in the dividend. Without such examples involving zero, there would be little 

quarantee that performance on the test items would generalize to all the types 

of long, division examples a child might encounter. 

In describing the term "domain-referenced," Donlon (1975) noted: 

The label "criterion-referenced" has -what Hi vely calls "surplus 
associations." Further, Hively has recognized that,. otH*-»duca- 
tional objectives are seldom detailed: We say we want the child 
to "know the alphabet," not to know the letter "a." We aim then 
at classes with related behavior; the model is not one of apprais- 
ing the "ability to jump from standing"--a domain of jumps, for- 
ward and back, sideways, landing on one foot, and so forth.... 
Hively and his associates have thus improved upon "classical" 
criterion-referencing. They have stressed the complexity of 
domains by pointing out subdomains (p. 39) - 

Domain- referenced testing is one approach to criterion-referenced testing 
in which considerable care is taken with test item selection to ensure that we 
can generalize from performance on the test items to the specific curriculum 
area (domains) that , the test items are selected to represent. 



Criterion- referenced testing can ready Its full potential only when 1t Is 
s o integrated into the day-by-day functioning of the classroom t hat it cannot 
be separated out as a "testing" activity . Indeed, its contribution to the direc- 
tion and programming of instructional activities should be such that the teacher 
sees it as indispensable for facilitating effective instruction. 

The diagnostic class profile is- a basic classroom management companion of 
a criterion-referenced test. Unlike man^ ."clinical" tests, a school-oriented 
criterion- referenced test has to take into account the management problems faced 
by the teacher who is responsible for the total class. The basic parts of a 
diagnostic class profile are (a) a listing of the pupils on one axis of a ma- 
trix, and (b) a listing of the specific skill being tested on the other axis 
of the matrix. 

An example of a diagnostic class profile used with a criterion-referenced 
punctuation test (Hofmeister, 1972) is listed^in Figure 1. Along the top of 
the profile are 20 skills in a suggested order'of instruction from left to 
right. A listing of the pupils whose skills are being evaluated is on the 
left-hand side of the profile. The top right-hand corner of the profile lists 
the coding procedure used to record test data. Most class profiles can be 
adapted to monitor progress as well as providing pre- and posttest data. 

A well-structured criterion-referenced test should generate direct indi- 
vidual prescriptions for each child. In the case of the punctuation test 
(Figure 1), the individual prescriptions are obtained by reading from left to 

r 

right after th§ child's name. Small group prescriptions can also be obtained 
by working vertically down the class profile. Figure 2 provides another exam- 
pie of a diagnostic class profile (adapted from Morgan, 1981). In this example 
the results of an instrument for assessing preacademic skills are presented in 
matrix form. 
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A PRIMER ON INDIVIDUALIZED EQUCATION PROGRAMS 
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A GROUP MATRIX FOR MONITORING ACQUISITION OF PRE 'ACADEMIC SKILLS 
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The content of many tests is often accepted as unal terable because of 
association with normative testing in which alteration of either the test con- 
tent or the acj^inistration^ pro cedures results in invali dating any normative 
information xsollec ted from such administrations. In some criterion-referenced 
test situations, alterations can be made without invalidating the test. In 
the math combinations test (Figure 3), a number of the items require negative 
numbers as answers. If a teacher feels that these negative number problems 
are inappropriate for her needs, she can delete such problems to make the 
test more responsive to her needs. 

Random and Linear Access , ^ 

In the math combinations test (Figure 3), there is very little inherent 
sequence among the subtraction examples. Because of that fact and^the rela- 
tively low conceptual level of the task, it makes little difference where one 
begins teaching. This test is an example of a random access test. 

There are other test areas where sequence is important, as with the sub- 

i 

skills of the long division algorithm, or a spelling list based on word diffi- 
culty. Tests in which sequence is important are termed "linear access tests." 
The designation of a test as a linear or random access test has a number of 
instructional and testing implications. In a random access testing situation, 
flash cards can often be used both for testing and teaching. The.use oT a set 
of flash cards for each child is one of the quickest and most practical ways 
to identify and group the items q child knows and does not know. In a linear 
testing situation, it is not always necessary to test all the skills in the 
test area. For example, in spelling it might be sufficient to test until the 
child starts failing and then start teaching. Further testing after the child 
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Figure 3: Math combinations test in subtraction with diagonal sequences 
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has started failing would certainly be aversive to the child, and very likely 
a waste of instructional time. 

Cross-Referenci hg 

Prescriptions based on the results of criterion-referenced tests, where 
possible, should cross-reference from skills to /instructional materials. Skills 
might be cross-referenced as shown in the following example. In the example, 
the page numbers refer to the text being used in the child's classroom. 



- — — - — . ■' -■ ' ■ - - — ' 

SKILLS 


INSTRUCTIONAL EXAMPLES 
PAGE NUMBER 


test examples 
page Number 


1. parts of a mixed number 


172-173 


174, 192, 456 


2. mixed number products 


176 


184, 192, 456 



Commercial Criterion-Referenced Testing Systems 

A number of companies publish comprehensive testing systems which provide 
data on a child's performance on several hundred skills. Some of the systems 
require computer scoring services. Some of these testing systems can be cross- 
referenced with most of the major basal reading programs and math texts in use" 
in the schools. Examples of some of the available criterion-referenced testing 
systems are: The; Prescriptive Mathematics Inventory, published by the California 
Test Bureau, A Div.ision of McGraw-Hill Book Co.; The Fountain Valley Teacher 
Support System, published by Zweig Associates; The Wisconsin Design Program, 
published by NCS Interpretive Scoring System; and the Beginning Assessment Test 

* s. ■ - ■ 

for Reading, published by Lippincott. 



The following description from the preface to the Teacher's Handbook for 
Diagnosis: An Instructional Aide - Ma them atics, Levels A and B, (developed and 
published by Science Research Associates, 1980) is representative of the approach 
taken in' some of the well -developed commercially available criterion-referenced 
testing systems: 

Each diagnosis lab provides sets of diagnostic probes — exercises 
designed to help the teacher identify the specific weaknesses of a } 
student. The exercises are based on the comprehensive lists of learn- 
ing objectives on the back of the probe. By freeing the teacher from 
the time-consuming task of developing detailed diagnostic tests, a 
diagnosis lab enables him to focus his efforts on the instruction or 
remediation needed by each student to correct identified weaknesses. 

Also provided is a Prescription Guide with which teachers and 
students can quickly determine where--in a large^number of texts and 
supplementary learning kits—materials pertinent to the achievement 
of each objective are presented. Multiple references are %, given for 
every learning objective. Thus, if the student has had difficulty 
with a given text presentation or other instructional material, he/ 
. she can be directed to another. This approach allows for a multitext 
and multimedia approach, accommodating a wide variety of learning and 
teaching styles. • ' . v 

While some educators still champion "tacit learning" and stress 
the impossibility of reducing all aspects of the educational process 
to behavioral objectives and demonstrable outcomes, it is generally 
accepted that mastery of fundamental skills is, perhaps, best taught 
in this fashion. This is the basic premise of the series of diagnos- 
tic labs; to provide a convenient Method of helping students attain 
all the fundamental skills and concepts upon which much of their 
future education will rest. (p. 1) ° 

Setting a Criterion 

One of the major purposes of a criterion-referenced test is to help deter- 
mine which skills to incorporate in remedial instruction. The manual accompany- 
ing *a criteri on- referenced test should specify skills to be tested and the 
sequence in which these skills should be taught, As yet, not enough research 
has been done to indicate precisely what degree of success should be used to 
indicate when a skill, is mastered. The following are guidelines for setting a 



criterion: 
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1. A criterion should be based on the subject matter , and one level of 
attainment (e.g., 95 percent correct) should not be expected to apply to all 

i 

isubject matter areas. 

, . . . • 

1 2. The range used should be 80 percent to 1.00 percent . If a skill is 
important in terms of personal safety (for instance, driver's training) or as 
'a prerequisite to an important/ skill, a range of 90 percent to 100 percent would 
• be appropriate. 

1 3. The criterion should be related to the nature of the test . If *the test 

item was designated as follows: 

Question (1) 34 
-19 

then a criterion of 80 percent on the total test might be appropriate. If the 

test question were of the form: 

* ■ '< ■ 

Question (l) - 34 Check one: (a) 13 
-19 (b) 14 

(c 15 
(d) 16 

then a criterion of 90 percent might be more appropriate because of the chance 
factor and prompting associated with the multiple choice format. 

4. A criterion may take into consideration the performance of others . A 
level may be established by referring to the relative position the student holds 
in a particular group. This adds a norm-referenced element to the test. 

5. A level may be set by judging minimal competence . Experts decide what 
score a minimally competent person should obtain. 

Use of Profiles irr Planning Educational Programs ' 
Teachers and other school personnel are often interested in the relative 

4 

levels of mastery that # a student demonstrates in various skill areas and/or in f 



the differences in performance across skill domains within one particular test. 

Although the construction of profiles from test scores is a common practice, 

their analysis and interpretation are complex procedures. School personnel must 

be cautious in using such information for purposes of educational diagnosis and 



program planning. • » < 

Salvia and Ysseldyke (1978) note that "educators expect children with above 
average intelligence to perform better than average in their academic work. If 
their achievement is not also above average, it is c often a source of concern" 
(p. 408). It is also true that children who achieve relatively low scores on 
intelligence tests are expected to perform below average. Too often, poor per- 

formance on a test of ability leads to expectations of poor performance in other 

j 

skill areas. 

Professionals have used assumptions about the correlation between ability , 

and achievement to support classification of students in different areas of 

exceptionality. Salvia .and Ysseldyke (1978) point out that: 

Flat profiles of individuals whose functioning measures signifi- 
cantly Below average in both intelligence and adaptive behavior 
are used to confirm diagnoses of mental retardation. .. .A child 
who has a significant discrepancy between measured intelligence 
and both measured achievement and perceptual or language func- 
tioning, or both, may have a learning disability, [p. 409) 

It is also assumed that program planning may be facilitated through use of 
profiles of achievement tests. Pdor performance in one or more academic areas 
may indicate a need for additional instruction. Conversely, high achievement 
in an academic area may indicate special interests or skills which can be capi- 
talized on in instruction. 

If profile analysis is to be of use in developingMnstruction, attention 
must be given to the reliability of score differences and to the differences- in 



norm samples. Salvia and Ysseldyke (1978) provide an example of profile analysis 
which is reproduced in Appendix X. * 

Activity 

Select a nonii-refe_renced_ a^ieyem schools: 
1. Analyze the contents for adequacy in assessing a specific ability of 

students (e.g., multiplication of two-place numerals; inferential comprehension 

of grade level reading material). 

( 2. Compare the test content with the scope and sequence of the curriculum 

being used in the school. ' 

3.' Identify specific changes in instrument content and test procedures 

(e.g., use* of oral responses , written responses) that allow for more precise 

recommendations to be expressed in terms of the curriculum and materials being 

used In the pupil's school. 

Evaluation of Intervention Effects 
The success of any effort to improve -a student's academic and/or social 
performance should be evaluated from two aspects: (1) The extent to which the 
treatment results in significant change and/or progress, and (2) the extent to 
which the" treatment program is valid. 

Evaluation of Intervention Outcomes 

Public Law 94-142 requires both assessment of students who are receiving 

special education^ service and educational interventions and the evaluation of 

' ■ • j 

the effectiveness of those services in achieving objectives for the students. 

The current emphasis on individual educational plans (IEPs) has resulted in a 

need for the school personnel to become involved with assessment of outcomes of 
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their programs for handicapped students. Beyond this mandated assessment of the 
programs of a relatively few of the. students in regular classrooms, much benefit 
may be gained frott expanding program evaluation to assess the progress of all 
students. / v 

In his discussion of the assessment of behavioral change, Phye ( 1979), 
points out that the educational professional is concerned both with the nature 
of the change and with the evaluation of the impact of the intervention. 

Nature of the change . Here, the types of questions to be asked deal with 
the reliability of the data shewing a change in behavior and the direction of 
the change. Evaluation in this area is typically concerned with the improvement 
and/or modification of the intervention program. A standard method of assessing 
the nature of a change due to intervention is through a simple pretest-posttest 
procedure. In addition, the assessment of instructional objectives must be 
dealt with on a continuing basis at all levels of an instructional task in order 
to monitor instructional methods and materials. 

Evaluation of intervention impact . To evaluate the effectiveness of the 
educational program the following question should be a^ked: "To what extent wars 
the observed change a result of the intervention treatment?" Here the program 
to be evaluated may be any program or curriculum by which a student's education 
is guided. The "treatment" may. refer to the standard program in a regular, 
classroom or a modified program in which an individualized educational plan is 
carried out. 

Given, the ethical and practical restrictions that are placed on the profes- 
sional in the school setting, evaluation of program effectiveness via "true" 
experimental design is not generally possible. Phye (1979) therefore suggests 
that some form of time-series design would be valuable in evaluating program 

,1 
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impact. In other words, an on-going evaluation of a program may not be abfe to 
demonstrate that a (pjrogram is necessarily better than ottyer possible programs, 
but it should be able to demonstrate that students in th&t program are progressing 
over time. - 



Trea tment validity . Closely related to the issue of evaluating program 
effectiveness is that of treatment validity. 1 It is common practice in special 
education to use certain tests as a basis for prescribing educational treatment. 
When tests are used in this way, it is necessary to assess their treatment validity 
i.e., to assess the degree to which they enable educators to accurately describe 
a program's effectiveness. In this section a procedure is described for assess- 
ing the treatment validity of a test. 

TheYe are essentially three areas of possible threat to treatment validity. 
These areas were described by Gallery and Hofmeister (1978) as: (a) the lack 
of a relationship between test and treatment; (b) the low quality of treatment, 
and (c) the lack of relationship between treatment and cul^riculum. 

Relationship between test and treatment . Can an educational treatment be 

✓ 

prescribed, given the test results? If the answer is no, decisions about 
treatment are unreliable. The treatment decisions may result in the student's 
failure to achieve, and such failure would be difficult to assess since it could 
be the result of inaccurate measurement, ineffective treatment, or both. Related 
to this concern is the teacher's ability to determine a starting point for 
treatment, If. the test results do not give some indication of where the treat- 
merit should begin, the treatment may be inefficient or ineffective. v 
Quality of treatment . Was the educational program field-tested or j researched? 
There must be empirical evidence 'for an assumption that the program should yield 

p j. ■ ■ . 

affirmative answers to the following questions: 



1. Is there evidence that the skills being targeted in the program were 
mastered by students on whom the materials were field-tested? 

2. Are the responses required in the student assessment similar to those 

v 

required in the educational program? 

I 3.' Are the students on whom a program was field- tested similar to the 
pupil (s) being assessed? ^ 

Re lationship between treatment and curriculum . To what extent are the 

' ■ ■ ! 

I. 

program objectives contained in the curriculum? The issue here is one of 
efficient use of time. A discrepancy between program objectives and the curri- 
culum content could mean that the program has little relevance to the student's^ 
needs. 

Validity involves all interpretations of the assessment data. Validity 
does not necessarily refer to the nature of the test(s) being used. That is, 
one cannot automatically assume treatment validity for a criterion-referenced 
test and for a norm- referenced test, The extent to which test results can 
assist a professional concerned with planning effective educational programs 
depends on the degree to which the criteria outlined are met. 

Conclusion 

This overview of educational assessment and its purposes has been designed 

* 

to assist the progress of the diagnostician through the complex maze of educa- 
tional decision-making. 

Educational assessment is a multidimensional procedure by which the infinite 
variety of a chi Id's- behaviors is observed and evaluated. Legal and social 
mandates,. combined with research findings, delineate the responsibilities of 
chool professionals in assessment. These requirements have resulted in a crucial 



need for educational "decision-makers to understand the nature and limitations of 
assessment technology. 

The goal of educational assessment is the generation of educationally rele- 
vant decisibns designed to make positive differences in the lives of children. 
School personnel must be prepared to be accountable for such decisions. One 
measure of such accountability will be the valid and reliable relationship be- 
tween assessment, the demonstrated needs^oTMhe student, and the success of in- 
structional strategies designed to provide for those needs. To assess the pupil 
and ignore the instructional environment is to imply that the pupil is totally 
responsible for his/her level of educational attainment. ,/ 

In this module assessment strategies and issues* have been covered in a very 
cursory manner. Obviously, adequate competence in pupil assessment requires' 
much more than familiarity with the contents of this module 1 . Considerable prac- 
tice and experience is required to develop assessment skills. Some of this 
practice and experience should be a part of all classes that deal with methods 
of instruction, whether these deal with reading methods for elementary school 
teachers or science methods for high school teachers. Some of this experience 
should be gained in well-selected practicum placements. 

Attached in the appendices of this module are a few exercises which could 
be used in teacher education programs. Of course they are only a beginning. 
What is crucial is that teachers leaving today's colleges have a background in 
and commitment to on-going student evaluation. It is only then that we can 
feel confident that, . in an era of growing heterogeneity in school populations, 
an appropriate education will be provided for all of America's children and 
youth. • .' " • 
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Post test 

. — — <r 

1. ... According to .Pub 1 i c Law 94-1 42. the ..primary purpose of assess^nt is to 

a. develop appropriate educational programs for handicapped children. 

" b. make . educational decisions about the placement of children in curricula 
and programs. Y 

c. evaluate the effectiveness of the child's individual education , program 
in meeting identified goals and objectives. 

d. all of the above. 

2. Because school professionals have different training and unique skills, the 
responsibility for educational assessment should be 

a. allocated to the person who spends the most time with the child in 
educational settings. 

b. the sole responsibility of the school .psychologist as a function of 
his/her training. * 

c. an integrative process involving every person who has contact with 
the child .in the educational setting. 

' d. the co-equal responsibility of those who are in a position to contribute 
educationally relevant information w about the child. 

3. Continual evaluation of the child' 4 s progress is necessary for the following 
reason(s) : 

a. to make' sure the assessment instruments \ised reliably identified the 
general nature of the child's problems.^ 

b. to ensure that the child is not causing further problems for the teacher. 

c. to ensure that the student is in the right curriculum and is learning 
at his/her maximum rate. 

d. to ensure that the*' student's placement will be final and that there- 
will be no threat of his/her personal adjustment because of movement 
tcf a new position. 
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In using the information from observation and interviews, school personnel 

» • * 

a. can view the information as accurate because of the reliability and 
validity of the instruments used. 

b. knowJ;hat they have obtained accurate information. 

f 

c. know that the Information they obtained is more accurate than informa- 
tion .from only the child's teacher because the latter is not specially 
trained xo assess students. 

d. know that tnterview-observatlon techniques are too subjective to yield 
precise and reliable information, but can be used to supplement and 
verify other data gathered on the' child. * ' ' 

A criterion- referenced test places a .child in terms of 

a. a sequence of tasks. 

b. a set of percentiles. 

c. other children. 

d. a set of norms. 

Norm- referenced tests are often 

a. sensitive to a specific curriculum. 

b. good diagnostic instruments. 

c. insensitive to a specific curriculum. 

d. useful for directing specific remedial programs. 

A domain- referenced test is one form of a 

a. standardized diagnostic test. ' ' 

b. norm- referenced test. 

c. standardized achievement test. - 

d. criterion- referenced test. 
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8. The intelligence test is a 

a. norm- referenced test. 

■ i 

b. criterion- referenced test: 

c. ^eroain-referencecl test. - \ . 

d. achievement test. 

9. If a criterion- referenced test was used to rank the pupils in a class, 
the test would be used as 

a. a criterion-referenced test. 

b; an achievement test. 

c. a norm-referenced telst. 

d. a (Jomain-referenced test. 

10. There is a strong movement to de-emphasize testing for purposes of 

a. identifying and classifying. 

b. remediation. 

c. specifying students' present level of skills. 
td. planning educational programs. 

11. The most used special education testing procedures are those procedures 
which * 

a. give a percentile ranking. 

b. facilitate remediation. ' 

c. facilitate giving end-of- term grades. 

d. place a child in relation to his peers, 

12. When a child meets j criteria on a domain- referenced test, he should 

a. have mastered the test items only. 

b. be able to master all examples of the domain when encountered. 

c. have mastered ajt least half of the possible examples of that domain. 

d. . none of tne above. 
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13. When selecting an assessment instrument, professionals should first 

a. decide on the scoring procedure. 

b. make sure that there are at least two forms of the test. 

c. clarify the purpose of the test. 

d. make sure the students can understand the directions. 



14. For criterion- referenced testing programs to be effective, * 
a. they should be administered by an impartial outsider. 

' b. they should be administered at the end of the year, 

c. fl they should be integrated into the daily teaching procedures. 

d. they should be administered at the beginning of the year. 

15. A matrix with one axis listing the skills and the other listing the pupils 
is a 

a. table of norms. - 

b. diagnostic class profile. 

c. individual prescription. 

d. standardized test. 

16. A criterion-referenced test can be made more practical by 

4 

O 

a. adding norms. 

b. expressing results as ^a pe rcentage. 

c. cross-referencing the skills. 

d. expressing results as ranks. 

17. A diagnostic class profile can be used for . 
- a. recording pretest data only. 

b. recording pre- and posttest data and monitoring student progress. 

c. recording posttest data only. 

d. recording the data on which each class is given. 
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18. A well-constructed criterion-referenced test should 

a. generate prescriptions for direct individual instruction. 

b. generate percentile rankings. 

c. provide information regarding the appropriate norm- referenced test 

to give. v 

d. none of the above. 



19. If a teacher feels that parts of a criterion-referenced test are inappro- 
priate, he/she should 

a. , not use that particular test. 

b. adapt the test by deleting the parts he/she feels are inappropriate. 

c. make up his/her own test. 

d. delete those parts he/she feels are inappropriate, but realize that 
- the test is 'no longer valid. 



20. Test developers claim that Test A is more reliable than Test B. To determine 
the accuracy of their claim, what information would you need about Test A? 



21 . s The authors of the WRAT state that no attempt was made to obtain a representa- 
tive national sample of students for the standardization of the tes-k, Each 
leVel" of the test was standardized on at least 150 males and 150 females at 
each of nineteen age levels, producing a total standardization population of 
5,868 persons at Level I and 5,933 persons., at Level II. Norms were not 
stratified on the basis of race, ethnic group membership, socio-economic 
level or geographic region. Schools in only seven states were included in 
the standardization sample. No handicapped children were included (Salvia & 
Ysseldyke, 1978, p. 160). 

Identify five characteristics students may possess that require caution 
in interpreting test results and that may demand adaptation in test ackninis-* 
tration. . 



22. What are the two questions to ask when evaluating the nature of behavioral 
or academic change in a student during and after intervention? 
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23.* When assessing treatment validity, Whfcti* three areas will be of possible 
threats to validity? . t.' 



24. How do the needs of administrators in regard to assessment information '• 
differ from the. needs of teachers? What are the practical implications 
of these differing needs? . . 
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Exercise 1 

It has been noted in' the research literature that the lack of mastery of 
sounds of letters is a major skill defici t in many poor readers. You 

♦ 

will be presented with- a paragraph which a student has read with markedly 
poor skill. Specific problems are identified in the test by a code which 
appears beneath the paragraph. Look for a consistent pattern and frequency 
of errors. Design a criterion-referenced test which will cover all the 
problems identified. The. test will be individually and orally administered 
as a pre- and posttest to monitor instruction in the pronunciation deficits 

■- ■ 

Also prepare a diagnostic class profile to be used^in association with the 
test. The class profile should include the following components: y 

a. a space for listing at least 10 pupiSs; 

b. a listing of the sound being evaluated, and 

c. a clear and simple coding procedure for entering the test results. . 
.., The coding system should allow for updating the profile as skills 

are mastered. 

All the administrative procedures should be describee* in sufficient detail 
so that another teacher might use the instrument without additional in- 
formation and/or training. 
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Reading Paragraph 



• (very), ■ , VAN'S GAVE 

( n ) A ' (prvnowiCii "d") 

Van is(an>l!|, old mgh. Jfe lives in a cave near a lake. Va^ has a A " 

• (o) ^ (said "bed" at 

bed and a stove in £he)cave.. Van made @ bed of old(gmterT) He made © Aoye / ^ 8 ° 

reatd '7x?<i" at /tret; 
of old bracks. He sleeps in the bed. Spot likes, to sleep near(^the)stove . His 



bed is just(an)old coat . % 

(a) (live) . (o-) ■ 

Spot likes to live in Van's cave. It is home f or (fh^ old man and (£h<j) dog. 

! (o) (a) . (o) (a) 

Onc^ Van and Sf>6t went to hunt ducks. V£n saw a flock of ducks land oh (the) lake* 

/ (jjrd) (fird) (o) 
H<£ fired and fired at the ducks. ,f I hit five ducks, V said Van. "Jump into(£h<^ 

(a) (a) \ 

water, Spot, and get Qhp) duc^ f or me." Spot jumped into the waves and swam to 

get (th<^ ducks. 

Sco ring Code 

1. * (letter or word sounded incorrectly) 

2. C^Z^ ( word skipped) v 

3. c V (word or letter which student self -corrects) 

4. A (insertion) * 

5. sk (rows skipped) 
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Exercise 2 • 

You will be presented with a case report of a student who has been referred 
to a school psychologist for evaluation. On completion of the reading, decide 
whether you , have sufficient information about the child to make recommendations 
for him as regards educational placement and treatment. If you do not feel that 
there is sufficient information, what additional data do you require and how 
will you obtain it? Detail the procedures you would follow and the methodologi- 
cal considerations you would make 1n your choice of assessment instruments* In- 
clude an outline of the procedures you would follow in evaluating the success of 
any educational program youNmight recommend. Discuss the result of this exercise 
with other members of the group. f 

Case Report 
Client : Uadell P. « ■ 

Age: 10.7 

Birthdafr e: 2/3/65 ' 

Date of Ev aluation : 3/10/75 

Parents: Edward and Jane P. 

327 East 800 North Boulevard . 
Los Angeles, California 

Refer ral Reason : 

Uadell P. is a black student who was referred by his. teacher, Mrs. Sharon K., 
and Principal, Mrs. Noreen S., of A , School for psychological evaluation 

and possible placement in a service plan for an educationally significant handicap. 
Tests Administered: Stanford-Binet , IM, Intell igenca* Test 

— , — ■ — > . \ 

\ 

Stanford Achievement Test 

Draw-a-Man (unscored) 
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Background Information : 

Wadell P, transferred to A School oh January 7, from a school in 

Los Angeles, California. His reeores were not available from that school at this 

time, but his current principal, Mrs*. S ' " • , related that Wadell's mother indi- 

i - . 

cated he "had some problems" at the previous school . He was placed in the class- 

•» 

room of Mrs. K and over the past month she has voiced some concerns which 

J * necessitated thi s referral . Specifically, Mrs. K reported that Wadell 

does not seem to be 



interested in making friends or in the activities within the 
classroom. She describes his behavior as "impulsive" but generally "underactive, 
as he seems to act 



to make approprtat 



jin slow motion." Often he "raises to talk," and often fails 
responses in social situations (i.e., doesn't talk to other 



i 

children when spoken to, doesn't join in games). She also indicated that "he 
is a "clumsy child, jor at least uncoordinated f<&> his age. When you can get him 
to respond, he seejns to be a little behind in all subjects, but especially read- 
ing." ! . 

On the first day of the evaluation, Mrs. was in attendance and. pro- 
vided the* fol lowing information. Wadell is the second of four children. He has 
had no significant- illnesses up to this ifime. When tested previously, his 
vision was believed to be 20/20 in both eyes and his hearing was "OK." Mrs. 

i 

P stated, "I don't think there is a problem with Wadell; he's fine at 

home." Then was added, "Mr. P is employed as a plumber, presently, and 

the family receives assistance through the Department of Family Services: " Both 

parents reportedly compl eted the ninth grade. Mrs. P worked as a sales ; 

i • ■ \ * . . ' ■ , . 

clerk "before getting married and becoming a housewife." Mrs. P reported 

that both parents take little interest in community affairs. 
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Behavioral .Observations : 

The tests were administered in two morning sessions on two consecutive days. 

* * 

On the first day, Wadell was brought to the testing room in the school by his 
teacher. When introduced to the examiner, Wadell remained quiet. At this time, 
Wadell was only given a Draw-a-Man, which was not scored, and whose purpose was 
only as a rapport builder. On the second day of testing, Wadell was frequently 
verbal with the examiner, and hi s speech coul d be characterized as "alow." 
During administration" of the Stanford-Binet (an I.Q. test), some of the answers 
were impulsive, especially for the memory-for-digits items. Although rapport 
could be characterized as good, Wadell seemed quite distractable from the task 
at hand when the examiner would reach i.nto the kit for the next item. Wadell 
remained in his seat except on two occasions. When walking, he seems to drag 
his feet in an uncharacteristic gait. He does not hold a pencil solidly. 
T est Results : 

The Stanford Achievement Test^w^ administered first as a broad-based 
assessment of Wadell's academic achievement up to this point. He was adminis- 
tere<*-the Primary I .Battery (or Intermediate II Battery) and according to the 
norms supplied, obtained the fol lowing scores : • 



a . 


Word Reading: one year behind 


a . 


same 










b. 


Paragraph Meaning: 10 months behind 


> b. 


same 


c . 


Word Study'Skills: 10 months behind 


c . 


same 


d. 


Vocabulary: 4 months behind 


d. 


. same 


e. 


Spelling: 5 months behind 


e . 


same 


f . 


Arithmetic: 6 months behind 


f . 


Arithmetic 



(T) Concept Formation 
3 months behind 

(2) Computation 

3 months behind 

(3) Application 

5 months behind 



< 
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The Stanford-Binet was administered next as an indicator of Wadell's ab- 
stract verbal learning and problem-solving ability. The test^results were con- 
sidered to be val id as Wadell was passively cooperative. According to the norms 
supplied, Wadell received an IQ=77. He had fpartlcul ar problems on the vocabulary, 
maze, and memory for digits items. He was unable to give a reasonable answer 
when asked, ".What would you do if you were asked by a stranger how to find the 
nearest service station?" (Answer: "Who? What service station?")'. Scattered 
throughout the o/ther items were answers which can only be characterized as a puz- 
zled look, as if Wadell just didn<t understand the question. It is felt that 
Wadell has difficulty with receptive language. Questions had, to be repeated; 
he did not engage in conversation. |jf 
Summary 

Wadell's assessment indicated that he is performing at a low level academi- 
cally, particularly in receptive and expressive oral and written language. It 
should' be noted that when a social worker visited Mrs. P at home, she 

found that Wadell's behavior at home is in sharp variance with his behavior 
at school. He is capable, happy, and talkative with his peers. No one in the 
family is concerned about his pattern of poor performance at school . 



v 



•63- 



G8 



to 



v " Exercise 3 . 

Take a commercial elementary school text in arithmetic. 

* 0 

1. Develop a criterion-referenced test that covers the major sk'ills which 

^students are expected to learn while working in this text. 

2. \ Design a record that would allow a teacher t6 keep a sequenced, ongoing 

record of student progress while working in thistext (indicating your 
criterion for mastery of specific skills). 

3. Develop a brief screening test which would allow you to 

(a) determine readiness' of a student to use the text, and * 

r; . 

(b) to place students at the appropriate place within the text. 




Exercise 4 

t ■ — — - - - — 

It has been noted in the research 1 iterature that the lack of mastery 
of the sounds of. letters is a major skill deficit in many poor' readers. Design 

* 

a criterion-referenced test that would be individually and orally.adjninistered . 

\ 

The test should cover: 

(a) all the consonants, ; ^ ' 

(b) all the short vowels, 

(c) all the long vowels, and 

(d) several common" consonant blends.. 

Also prepare a diagnostic class) prof il e to be used in association with 
the test. The class profile should include the following commorients : 

(a) a space for listing at least ID pupils, 

(b) a listing of the sound being evaluated, and 

(c) a clear and simple coding system should allow for updating the - 

profile as skills are mastered. 

> — 

All ~fche administrative procedures should be described in sufficient detail so 
that another teacher might use the instrument without additional information 
and/or training. 'f 



Exercise 5 

% 

. .. ■ , ...». ,. 

The situation : A high school remedial math teacher set up a grading 

system for the end-of-term reports as follows: A = 90%, B = 80%, C = 70%, 

D = 60%. The percentages ^efer to the average of the mid-term and final exam 

results. How might the teacher apply some of the„ mastery learning constructs 

and still award grades? 



/ 
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! Responses to Exercises 

— . 

You will note that there is a significant pattern (or set of patterns) to 
errors made in reading this paragraph. There are numerous cases of the reversal 
of the letters "o" and "a" in different words. Some words were substituted for 
those in the test, and there was a constant omission of "the" and "an," though 
significantly not of "a." Words containing "i" were mispronounced. Errors in 
the second paragraph indicate that the student did not discriminate the word, 
"stdve." He/she seemed to expect that every reference would be to "bed." 
However, he/she did make a correction on both occasions. Any remediation should 
focus on these deficits. Your criterion-referenced test should be constructed 
to monitor progress 1n these areas. When constructing the test, remember to 
include criteria for mastery and to rationalise your choice. 

Information presented in this case study is not adequate for you to make an 
appropriate decision about educational placement and treatment for Wadell. 

a. There seems to be a discrepancy between Wadell 's behavior at home and at 
school. You would need more information aboutNSuch variables as the 
teacher's expectations of Wadell, demands made on him by the cla'ssroom 1 
environment, and the nature of reinforcement methods employed in the | ; 
classroom. . - ' . ;\ 

b. The testing instruments used should, be evaluated to determine if they were^ 
*~ appropriate, particularly in terms of language, concepts tested, relation- 1 ' 

i 

ship to curriculum, etc. , " \ 

i \ 

c. You would recommend that further assessment be conducted. A thorough \ 

assessment of language, both receptive and expressive, Is necessary. \ 

■< . 

v \ 

d. You would recommend further assessment in deficit academic areas, with i 
particular focus on criterion-referenced information. You would, of 



course, outline the considerations you would make in selecting the assess- 
ment Instruments. 

e. Following the assessment process, you would examine the curriculum in which 
Wadell was placed to determine which deficit areas are the results of 
inadequate or inappropriate classroom learning experiences and which are 
the results of learning problems, j 

i 

Respons.es will vary according to the text selected. Students may benefit from 
comparing responses with students working from the same text. Comparisons of 
criterion-referenced tests based on different texts designed for the same grade 
are often useful in showing how curriculum can affect a student's preparedness 
for standardized, norm-referenced achievement tests. 

$ 

The attached list of basic sounds might be used as a resource for this exercise 
if the participants do not have curriculum knowledge in this area. The major 
point to be brought out here would be the alternative of assigninf grades in 
terms of units mastered rather than in terms of average scores. For example, 
a grade of "A" might be assigned to students who master nine of the ten educa- 
tional units in a given course. * 

■ — i v *■ 
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Supplement for Exercise 4 
(Single- Letters) 




Sound _ 
Number 


Sound 




Key Words 




1 


m 




me, him 




2 


a 




apple, fat 




3 


s 




so, kiss 




4 


* e 




me, he 




5 


f 




full, if 




.6 


*d 




did, feed 




7 


r 




ran, rip 




.8 


i 




It, pin 




9 


c 




cat, traffi£ 




10 


0 




ox, not 




11 


n 




not, sun 




12 


t 




top, hit 


_ 


13 ^ 


h 




hat, how 




14 


u 




up, rug 




15 


g 




£0, ra£ 




1 6 


1 




lit, will 




17 


V/ 




win, watch 




18 


k 




kiss, mil k 






* 0 




open, go" 


■ f ■ — 


20 


^ ^ V 




very, 1 ive 





21 


p 




£at, si £ 




22 


e 




end , pet 




23 


b 




' big, rib 







y 


- 


^es, yellow. 




do 


J 




lump, ieep 




26 


X 


l 


•> 

' box, sitf 




27 


• — ; — ; Or 


t \ 


- ' 1 ■-■ -t — ■ — — — 

myi cry 




28 ' • 


2 


"*"T 


zoo, buzz 





4 - 







Letter Combinations; 

i 


• 9 


Sound 
Number 


/Letter 
Cpmbi nation 


- 


Key Words ' • 


29 


/ 1r 




bird, fir 




. 30 


~ 7 . ; 

/ th 




then, that 




31 


/ qu 




quit, queen 


32 


y . — _ — . — . — , 

/ er 




her, faster 


33 


~i — : — - — 

ea 

*4 ■ ' — 




seat, mean 


34 


ol 




old , bolt 


— - » — — * T 

35 / 


ur 




■ t ■ ■ ■ r*" 

\ ■ * 

turn, urn 

\, * 9 


1 

36 / 

• — . — „ —i- 


ee 




fe.qt, he* ea 


37 / 

/ — 


wh 




when, why \ 




m ■ 

00 

. -J 0 


- — -; v. 

* * . 

* * 


foot, moon'A 

j i 


r 


— ^- ■ 

3/9 


4 1 

aw 

r r - - . > 




jaw, flaw 1 

_j »■ • — . — t a. 


j : 

./40 


or j, ^ 


. * , , ■— 


' « i 'At 

for, order X 


* . 


- 41 


•* - 

• ai 


i. -* 1 i : 


maid, pa i n I 

* \ 


42 


■ • ' ( 4 ■ . - 

oa ■ \. 


i ** 


oat, load " \ 


43 


ou 


f 


out, loud . I 


"7- 

*44 


igh 


6 * 


night; sigh \ 

_! , V- 1 — 


45 


. r. « 




sta£, ,paj£ \ 


^ ,46 


*' a 1 




bald, fall \ 


a " 

.47 


: oy * 






"48 . 


sh ■ 




^shout, wish 


49 


^ . * r ■ " ' 




\ar, start 


" 50 


oi * 




iil , point 


51 


ch 




chop, rich 


52 


v ** a-e 




gate, plane 



f Letter Combinations 
,( Continued) 



Sound 
Number - 


Letter 
Combination 






53 


** 1-e 




like, dive 


54 


** o-e 




rode, home 


-55 • 


** u-e 




mile* flute 


56 


■ ^ » — 

v ew 




news, skew 




— ; ■ — — — ^ ^— — 



* e'» "o/y, V t the*11ne over these letters indicate that the letters be thelong 
1 sounds and lhavethe same s^urtd as the name, of the letter (e.g., as in be, go, 
cry, he, n<J A dry\ 



Tbese are long sounds {e.g., "a-e" is the long sound of V) 
fallowed by a "sile/ht e" (e.g., as in make, home, drive, fuse) 

W ' 

\ 

\ 

\ 

\ X/ 

• \ 




. \ 
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APPENDIX C 



Keys to Pretest and Posttest 
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■ ■ . Key to Pretest 



Short Answer Items 



1. To make educational decisions about the performance of students. 

« fUxil?l 



2. Testing is only one method of assessing a child. Assessment is f fl^x 
continuous process lea'ding to an ongoing program which may be modified in 
the interests of the student's Hfe situation and of a reduction in/his/ 
her current specific difficulties, / 

3. a. Selection and administration of tests in a nondiscriminatory manner, 
b. Provision of test materials and procedures 1n the child's native 



language or mode of communication 



c. Prohibition of! the use of a single test or procedure as the £ol e 
criterion for determining educational placement. 

4. a. Child's files.' > /'■ 

/ 

b» Information from significant others in the child's life. 

c. Observation of the child. 

d. Norm-referenced tests. 

\ 

e. Criterion- referenced tests. 

5. a. Current life c ire urns tances\ 

\ 

b^ Developmental history. 



c- Extra-personal factors. 

d. Situational factors. , 

a . ' Referral . 

o .,. .. . - 

b. Screening. ' - 

c. Evaluation of screening and planning interventions. 

d. Evaluation of intervention effects. 
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7. a. Observer bias. 

b. Awareness by the student that he/she' is being assessec 

c. inconsistency between interviewers. 

i 

j 

d. Test invalidity and/or unreliability. 

8. A student's scores on an achievement test reflect pupil ability as compared 
to others of comparable age level and the instructional effectiveness of an 
educational program. 

9. a. • Use of the test for purposes other than those for which it was designed. 

b. Use of ..the test for individual purposes when designed for use with a group 

10. a. To provide recommendations for instructional an<jf behavioral goals. 

>' ' . ; i 

b. To provide recommendations for educational placement. 

c. To measure present skills. I i 

" • ■ . i ! 

d. To measure progress toward goals. j , 

I ' 

e. To measure the effect of an instructional | program. 

11. Norm-referenced tests evaluate the child's performance by comparison with 
that of other children. Criterion-referenced tests evaluate the child in 
terms of some learning task at some absolute standard that is, independent 
of other children's performances. 

12. A domain-referenced test is one in which the emphasis is placed on precisely 
identifying skill areas (domains). The test items of a domain-referenced 
test are selected so that one can be certain that the child who meets cri- 
teria on the items which represent a domain (such as long-division of decimal' 
fractions using single digit divisors) would be able to meet all t,he other 

x examples of^a domain when they were encountered. 

13. a r Criterion should be based on subject matter. 

r v 

b. The range should be 80-1 00 percent . „• 

/ ~ ■ -74- ! . . " 
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. . .... t 

c. The criterion should relate to the nature(of the test. 

\ v- 
\ 

d. Performance of others. 

» 

e. Expert decision on minimal competence. 

14. Nature of the change in the student and impact of the intervention.. 

15. The degree to which tests enable educators to accurately describe a treat-j 

■ ' • ' / 

. ment effect. s / 

\ " •■ ' - , / ■ 

\ 16. a. Parental permission is necessary before initiation of diagnosis or $ 

, • . / 

evaluation and for placement beyond a regular education classroom./ 

V \ ■ 

b. Mul tidisciplinary evaluation. / 

c. Due process or procedural safeguards to ensure the educational rights\ 
of the child. 

1 True/False Answers 

1. F \ _ / 7. t - 

2. F |. • 8. T 

i 

i 

3. T ! 9. F 

4. F 10. -F 

5. F - 11. T 

6. F 12. F 

■ 13. T 
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I Key to Posttest 

1. d 6. c 11. b 16. c 

2. d 7. d 12% b 17. b 

3. ^a. 8. d 13. c 18. a 

4. d 9. c >' 14. c ' 19. b 

5. a 10. c / 15. b 

20. a. Validity of the tes^ for the purpose and the populations. 

/ . 

b. Information a bou^ technical adequacy of test 

(1) administration £ 

(2) standardi|ation/norming groups. 

/ . \ 

c. Knowledge of the physical and mental characteristics of the child bieing tested 

J 

d. Knowledge of curriculum in which child is currently placed. 

e. Reliability coefficients (for test and subtests). 

21. Answers should include: Characteristics of geographic region, -cultural/ethnic 
background, age of student (C.A, and M.A.), nature of disabil ity and its 

possible effect on nature and rate response; any medication prescribed for 

ft ■ * 

the child and its influence on the nature and rate of response. 

22. a. What is the reliability of the data supporting a change? 
b. What is the direction of the change? 

23. a. The lack of relationship between test and treatment. 

b. The quality of treatment. 

c. The lack of relationship between treatment and curriculum. 

24. Administrator Needs 
Student program placement. 

Evaluation of educational progress. , 
Appraisal of effectiveness of specific curricula and programs. 
Identification of students with specific disabilities for funding purposes. 

Teacher's Needs V 

Instructional ly relevant information. „. \ 

Precise knowledge of students' \spec if ic skills and deficits. \ 
Any other information that wil l\ facil itate effective intervention. 

J v ■ 

Practical Implications 

Nature of assessment instruments (norm-referneced , criterion-referenced, 
diagnostic rather than achievement test, relationship between test and 
curriculum sequence). 
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Adelman, H. S., & Taylor, L. Initial psychoeducational assessment and related 
consultation. L earning Disability Quarterly T 1979, 2, !>2-64. 

Abstract : ' Criticism of current approaches to assessment 'indicates the need / 
for effective alternatives. Given a general understanding of the criticism, * 
t;he authors describe the basis for an- al ternative approach to Initial assess- 
ment activity. Specifically, the discussion focuses on (1) a conceptualiza- 
tion of Initial assessment and consultation; (2) the pro bl em- solving paradigm 
as a framework for guiding this activity; and (3) a description of procedures 
and ini ti al'^jp^tc^ from a demonstration program. 

\M 

Becker, W., & ErigCTlwann, $. Teaching 3: Evaluation of Instruction , Chicago: 
Science Research Associates, Jl'976. 

Abstract : TJds* bwk elaborates and exemplifies many of the constructs pre- 
sented in tHW section on educational assessment. Included in this book are \^ 
. n the following topics\: kinds of tests; understanding test scores; constructing 
ustructional - pro gr,w- based tests; approaches to monitoring student progress; 
outcome evaluation^ pri ter Tqn-referenced tests; norm-refjerenced achieve- 
ment t&sts; interpr^^ig norm-referenced test scores; and who can be taught • ^ 



^l>\' Gallery, M*, & Hofmeister, A/^M* A method for assessing the treatment validly 
1 of t£*£s in special educSPW&L The Exceptional Child , 1978, 25(2) , >Q5-113; 



* Hofmetstel^A. 'M. Testing and t^eatmWt validity. Journal of Learning Pisa - 7 

bilities , 1 979, 12_(3), 73-75,// V J ,. 

Abstract ; The above two articles Include specific recommendations to the 
psychologist who is concerned 'about selecting tests that* will have instruc- 
* tional relevance. A detailed frame of reference listing specific criteria 
f6r test^^l ection is' provided. \ * \ ^ 

Learning Disability QuarterVyT l 979,, 2(4) .. . - - , 

i * • • ^ ■ • . ' , . ... 

Abstract : This Wridl-e issue Mghl ights the assessment of learning disabili- 

* ti es . Jhree -article's' that are especial ly appl icabl e have been included in 
the*' Annotated Bibliography. « Vv'. 



Salvia, J., & Yss^ldyke, \J«. E. Assessment in special an^Ch remedial educaxlon . 

Boston: Houghton-Miffl'in, 1 9 TIT ~ 4 " ~ * "~ % " . * 

Abstract ' ; This text is designed primarily for; teachers in special and 
remedial education, but al stir ^or' the support system o%6peci-al education 
students, including counselor, «g'ucationa1 admin istra tors , school psycholo- 0 
gists, and. social workers. No prior knowl edge (of measurement and^tatistical 
concepts -is assumed.. 1 4 
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Parts 1 and 2 provide a general overview of an orientation to assessment. 
Part 3 provides detailed discussions and assessment of achievement, intel- 
ligence, adaptive behavior, and readiness. Part 4 1s integrative and deals 
with the application of assessment practices in special and remedial educa-* 
tion.^Part .4 1s felt to be particularly applicable to this^modul 

V • 

Thurlow, M. L., & Ysseldyke, 0, E. Current assessment and decision-making 
practices in model LD programs, learning Disability Quarterly , 1 979, 2(4), ' 
15-24. „. 

Abstract : .Data from questionnaires completed by forty-four Child Service 
Demonstration Centers were analyzed. Information was provided on the num- 
ber of^ children served, the LD definition used, the kinds of assessment 

, data collected, and the purpose for which they were used; the specific * 
assessmentkdevices used to collect data, and"the purpose for which they 
were used; the typical composition- of the placement team* and the major 

v sequential steps in the assessment/decisien-making process. Results sug- 
gested that assessment and decision-making 1n the field of learning disa<- 
bilities are Characterized by variability and' inconsistency. The impl 1c'a>* 
tions of the^findings for current assessment practices are summarized. 

. - ^ / 

Y§sel"<5yke, J. E.,' & Al gozzlne,, B . Perspectives on assessment of learning 
disaJSfced students. Learning Disability Quarterly , 1979, 2(4), 3-13.' 

~' > v ' . ' 

Abstract : Current critical issues" in assessment of 1 earning disabl ed 

students are described, with special emphasis on logical fallacies in.t,.he 
assessment process. New directions in assessment are specjf ifd and dis- 
cussed. * - '•< ^> 
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PAUL WEH MAN 
STUART SCH LEI EN 

Assessment and Selection of Leisure Skills for Seven ty 
Handicapped Individuals 



Leisure skills programming lor severely 
handicapped individuals is icceiving increased 
attention. For example, availability of leisure 
skill materials (Quilitch & Delongchamp, 
1974; Reid. Willis. J»rman, & 'Brown, I97H). 
type of materials (Quilitch 8c Risley, 11)73), 
and proximity ol Objects (Berk son 8c Daven- 
port. 1962; Wehmaii, 1978) are effective 
la hni<|ues which i 4 e<juirc minimal trainer 
intervention. On the* other hand, more, in- 
trusive types. of teacher assiMame huve heetl 

, demonstrated* such as reipjjoi cement t>l ap- 
propriate object manipulajton (hiuell. 1 97'1), 
modeling (Gabel. Hcndrickson, 8: Strain, 
1978; Mohij &• Doiker. 19^4.; Wehma'n 

d M;i reliant, 19.78), and task analysis (Mai chant 
fc chimin, 1979; Nictupski & Williams, 

'1974; Wehman fc Maitham", 1977; Wehman, 
Rcnzaglia. Berry. S( htij/, & Karstn, 1978). 

These efforts represent a significant step 
towatd documenting the leisuie skill capabil- 
ities of severely ;md profoundly handi( ap'ped 
individuals. RegrtMtahh however, little infor- 
mation is available relevant to assessing yge- 
appropriate >kills. I ; ui theimote. once a turn- 
miimcnt to leisure education has been made, 
teachers and other practitioners are faced 
with the billowing question: IVhuh Ivisutr 
skill(s) should be selected jar uwttucttunT With 
the Mrge number of leisure skills (e.g.. g;imes» 
hobbies) available, and the recreation skill 
deficits characteristic of most severely. handi- 
capped individuals, assessment and skill 



selection are pioccsses critical to el lit tent 
insti tie lion. 

"I he purpose of this paper is twofold I'h st. 
leisure skill variables will be idcntilfed lut 
assessment. These I ;u tors piovidc chtleinu 
type* ol data about an uuli\ idnal s leisuie 
activity. Second, ccitjin criteria will hv 
proposed which max be used as guidelines 
lor skill selection. I be present icpott is 
intended lor prat titioiters who woil* wiih 
individuals of all ages classiltccl as niodeiately. 
.seveicly, and piofoundly mentally ret aided 
(K>=0~i»l). 

* ■ • 

Leisure Skill Variables for Initial 
Assessment 

Assessineip of an individual's leisure skill 
eompvteiuies is neces\.uy hclorc designing 
an appropriate piugiam. Initial assessment 
will lu -Ip determine w hich skills the panic ip.mt 
can pel form independent!} and wfii< h skills 
requhexn lul, gcstui al, or physical assistance. 
Unloi tunatc I) k we at v-mx ;twarc of iiuy*ptih- 
lished or unpublished leisiucskill inventories 
oi ciitei ioii-relereiK cd en rricuhuu guides 
whic h are sensitive lojhe uuic|ue needs and 
problems of scveiely -ami profound!) handi- 
capped pel sous. Although work is underway 
(e.g.. Wehman, 1979). at this poiuut is neces- 
sary to use leisuie .skill inventories designed 
for higher-luiH tioning individuals or recrea- 
tion activity gtlit!c> with activities or skills that 
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have not been last analyzed, In the absence 
of a Comprehensive rurriailiVtn guide* the 
variables listed below highlight Important * 
leisure skill Ureas for functional assessment, 

Proficiency of Leisure Skill: Task Analytic 
Assessment 

Although there are a number of areas which 
can be assessed in a rccieation environment, 
an initial consideration must be whether the 
individual knows how to interact unth (lie materials. . 
Stated another way, when given leisure skill 
materials, qui the participant use tfjem ap- 
piopriately| If not, then systematic instruc- , 
ition is required*. 

What is requii^d for evaluating leisure skill 
proficiency is task analytic assessment (Knap- 
czyk t 1975). An instructional objective must 4 
be written fona given material. The objective 
should reflect the specific skill which the 
teacher wants the child to learn. An example; 
of %i task analytic assessment lor playing with 
a spinning top. is provided in Table 1. This 
table contains an instructional objective, a 
task analysis for playing with a top, and, the 
verbal cue provided during the assessment. 
The recording form indicates that for the 



first five days of assessment (baseline) the 
child performed a total of three, three, two, 
four; arid four steps independently. 1 here- 
fore. joMriictlon should begu^a'Tstep three 
in the task analysis, <\ t 

There are multiple advantages to tins type 
of observadorial assessment. First, the infor- 
mation collected about the child on a particu- 
lar play skill helps the teacher tQ pinpoint 
the exact point where instruction should 
begin. Therefore, the child docs not receive 
mstruetipn on skills in which he is at 
proficient. Anoth< r advantage is that sii 
step hrv^idualized instruction is facilj 
Evaluation of the child's proficienc)| 
different toys*over an extended pei 
lime will also be more objective and precise. 
at>d will be less subject to teacher bias. 

Duration of Activity 

If an individual has some degree of proficiency 
with leisure materials as keid- et jal. J 1978) 
found, then the instructional variable of 
interest may be the duration or length>K>f 
time the participant engages in actjvity. 
Duration may be assessed by recording the 
amount of time spent in dilteicnt /activities, 
■ " .j • \\. 




TABLE 1 

T%9k Analytic Amument for Haying with a Top 



Instructional Objective: Given" a lop. the child will spin the top independently a nuuimuin of live nines 
lor three consecutive day*. 1 



Verbal Cue: "Sally, play with the top." 



L S approaches top 

2. S plaits hands on top 

5. $ finds handle of top 

4. S pushes handle down on top ones 

5. S brings handle up J 

6. S brings handle down on top twice 

7. S brings handle up eaih nine y 

8. Sbringshandlcdowifoiiiopthrecotprt' ... 

9. S brings handle up ca|h time 

10. S brings handle down on toplfour limes 
11 S brings handle up eaih time 
,12. N S brings handle down on (op five times 
IS. S brings handle up each tune 

14. $ stops top from'sjrfhning 

15. S puts top away' 
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. . . TABLE I . 
Initial Object Aa*e»ment 
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I. ftnhall Machine 
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The length of lnL^P^^fHV)^'?"^ activity 
is particularly jinportani |Lo 'ftwess^causc of 
its rclcVH!KC^!> most hpnit ^ituatiqnist where 
parent caiUK>t 'constantly occupy time with 
their hajjditttppcd child. A frequently .heard 
request from Sti^iy parents is lit l^lf the 
child jo play independently, thereby tcjicyiiig 
the fahijly of continual supervision. A carefuY 
assessment of the child's duiapotvor)ci^iire 
activity helot e inMritdion Will help the teat her 
and parents set realistic independent ^leisure 
goals lot thex htkL "Fable 2 presents a sample 
data collection sheet. " ' 1 . 

Piscyiminatitig Hetwrn A ppropridtf t'rrsus . 
Inappropriate Objrct Manipulation 

Another assessment issue fated by leathers 
ami icseaichcrs is diHcrcMUiaim^;unnng* 
appropriate anions with objects versus ac- 
tions which would not Ik* considered appiopii* 
ate. Sc\eial play studies liave lailecl to atlfhess 
this issue (But ncy, Russell. Chutes. 1977; 
Favell Jt (iaiiuori, J977; \Vchman 8c Mart h.int. 
197*). Inappropi iatej>l«iY -actions have tvpi- 
iall\ been cousideied lh<>sy hchavinis which 
an- hafmluloi deslrtn live to the child, peers, 
or nuteiials Mowevei, pioloundlv leiatdert 
and autistic t hildien often evhihit Iti^h rates 
ol repetitive Nell-stimulatory behavior with 
toys, M-.. hanging, pounding, slamming, 
whit h arc not ncc essarily hartnl til pi i lest i uc- 

t . hie yet still ii^pprc»priaUvl ; tuthetuii«>re v the 
problem iv compounded shire w|t!i'|*ert;un 
nhjet is, hanging or stemming actions- may 
lie appropriate* Manychitdrcii will do unusual 
ihin^ with toys which might ,be considered 

* lippinprMte by other observers ((Joel/ 
Baer. 197:1). : 



Teadtefcs lire thus faced with how to a*Xc$* 
lbs qualitative nature of object manipulation. 
There are several ways of coping with i his 
^lifftculty.^li^ 
three obs^ 

observers rate the appropriateness of the 
action. Objective judging proy r ide> a chec ks 
and balances system fqr the teacher. : 

.A second method of assessing apropriatc- 
neSs of olyect mUt^pulation is to identif y the 
principal actions >bich a ponhatKhcart>ed 
child pf comparable mental age .might do with 
each object " (Fredericks, Baldwin, tirovc, 
Mpprc f Higgs, 8c Lyons, 197^). These actions 
may serve as gtiitlc lines. " ; 

Identifying a number of fine motor catego- 
ricws for object niatnptilation is another meati^ 
of coding the qualilative nature of responses* 
For exainplcN 1 Hton ;tnU QMmge; (1964) 
presetWfl nine categories, wliuh :^re self- 
expiauatt>ry, ahd which were identified after 
extensive observational analysts of normal, 
trainable retarded, and autistic children. 
These are Tepc^tjve ihanuat Inanipylation, I 
find contacts; pounding; throwing, pushing 
or pulling, personalized toy use, manipula- 
tion of movable parts, separation of pints 
of toys. am4 combinational uses of toys. 



LfisnYf Ityefcrnue Evaluation 

Assessing favorite . leisure ' ;U t j\ itics is jyt 
important step in . initiating « -a re< reatipo 
program. The goal-is. to identify Whit h; if 
any.at ti\ iticvsar'cvpiefetred by the partkipa'uti . 
\\\ emplnying cluiatioi? assessment, the 
amount of time spent w ith eac li leisure mate- 
lial is observed and re<or<led\ 

Latency is another ineastiw* °f assessing 
leisme prelereiue through pirs(*nting a sniall . 
number ol dilleient matei'iaK and deter* 
mining the amount ol time helot cm he panic i- 
pant respoiuU. McCall 1 1974) lias used latency 
as a measutc of the length of time which 
elapsed helpi.v* in>nt;et:irdc^l . infants acted 
cut a vaj iely of (Ejects wliich-were piesented/ 
p Kach of the cil»jetts possessed dilleient 
stimulus ; attributes* stich as ccuiligttral com- 
plexity of sound potential. Through ineascir- 
ing passage ol time tnuil a response, teac hers* 
may be able t<^evahiale the relative attractive- 
ness of and preleieiices for certain materials 
with severely handicapped individuals. 
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Piffrfrncc 

Functioning l^vcl 
I 

Physical .ChatJCtcristits 

■ I 

Ago Appropriateness 

I 

Access 10 Materials 



Support of Home 
^ Lmironme nt 



What skill* docs ihc client ahead? ck-moustiatc? 

Wharf aic the client's capahiliiirs and rdtMiiiioti.il needs? 

What physical diaiae tciislics dues the client have tu lack uliich may 
interfere with leisutc skill development? 

« 

Arc the skills which have hcen selec ted lor instruction appropi iite 
for uonliundic?ppcd peers'' 

l)«Rs the client ha nc access to materials (financial resouiccs. tiunspor- 
tation. etc,)? 

C „ 

, What person* are available in the home or nnghhoihoutl environment 
to reinforce leisure skill dcsclopmcm? 

FIGURE I. * 
General Factors to Assess in Selection tff Leisure Skills. 0 



Frfqutncy of hUmutwm 

F«i many Mrvercl) handicapped c hildren, an 
important insti tutional goal is to initiate and 
sustain interactions with' peers more Tre- 
(|ttentl>. A relatively common occurrence 
may l>e the piesencc ol .several handicapped 
children playing in isolation vol c**aeh other 
during Iree play tTiodeiicks, et ah, 1978). 4 
During these phy situations, the potential 
benefit* of social interaction are not acc rued. 

One way of assessing sot ta*l interaction is 
a simple count of the nmnherol times a ch:M 
initiates' :m intei action, teceives an inlet ac - 
tion, sustains an interaction, or terminates 
an interaction. Dotation assessment may be 
used to measure the length ol the inlet action 
, IxMweeli peers and also het ween the c hild and 
adults in the loom; A second moans ol gather- 
jijjj'tnoTe information on social inu racoons 
is the coding oil speciiic t\pes of interactions. 
Carney, and he:r associates Clobuciar, (lot ley* 
(Vilcox. Diglcr* Flcislci. I'aiiv, and Turner 
(I977)jiavc suggested 20 social intc taction 
skills tinder the lout interaction categories. ^ 
In addition to ptoviding .sctpict\ee t these 
skills may be task analyzed and "the c hild's 
proliciency oh selected behaviors assessed. 
These lour categories of interaction can 
be employed to cock' the tpi;ditati\e nature v 
of the interaction jllajnre-N'ietupski & 
WiKjams, 1977). I " 

Direction of Inttrattion v j 

Analyzing the direction of ime'ractjons can J 
Ik* helplul in assessing which individuals in */ 



the environment are t cinfore int» to the child. 
As Hevertd^e. Spencer, and Miller (I97H) 
observed, c liilcl-tcac her interactions occur 
mote !re<|dcn(ly llran tliild-child inte ractions, 
especially with severely handicapped children. 
St i net u red intervention h\ an adult is usually 
required to increase child-child interactions 
(Shores. Hester, & Strain. I97<>). 

I he dft et lion of interactions should he 
assessed doling home visits w hile observing 
the < hild playing with siblings or with neigh- 
hothoocl children. Data cm interactions with 
handicapped children and with tioiiliandi- 
, taj^)(<l peers should be refolded. This t\ pe- 
nt !>ehavidtal analysts can he ie\e;tlecbsince 
most uoultanchc apprel c hilcheiv do not in- 
clude handicapped children in play unless 
prompted and reinloneel by adults, (t'g.. 
ApolliMii & Cooke, 1978). . 

A Model for Selection of incisure Skills 

i ; * 

* While the leisure .sikill variables discussed 
above ate impot taut in the ptogiam develop- 
ment pioccss, it isecpiall) important toiex iew 

■ sjstv'uaticalh < liteiia fur skill selection. The* 
nature, of the assessment el.ua and lac tors 
imnhed in Finite I wrtl Vtiustitulc the initial 
skill selection. I licse tlitetia must be carelully 
assessed before beginning aerogram. They 
include tin* participant's leisuie skill prefer- 
ence, functioning level, physical characteris- 
tics, iigcMtppi opt ialet iess ol.the skill, paitici- 
panfs access in materials, and theepiality auef 
support available in the home environineiit. 
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Figure I outlines ;i sequence of questions 
whicji the leather should ask in reviewing 
skills lor instruction. Those guidelines will 
Ik* helpful in dctci mining the range of skills 
which insiy he .scire ted. The proposed skill 
selection model is c u 11 duly being field tested 
with severely handi<ap|>cd students of all ages. 

Lriwrr Skill Prrfnnur 

*\ he initiol question in consider in deter- 
mining whic h Irisine skills to select lor instruc - 
tion is, "How does the individual presently 
spend his hoc timer" Slated another wav, this 
C|tiestion refcis to what leisuic skills are cur- 
lend) in the individuals lepcrtoire. 

Preference is a valuable indicator hecausc 
(a) it may piovide the tcachci with insights 
as to the type or tatrgoiy of Icisuic ailivity 
that l lie participant enjoys, (I)) the activity 
may he used as a leinlorcer lor other new 
leisure skills which ate objectives ol institu- 
tion, and (c) it allows toe teacher todetei mine 
what the paititipant can alicacly do. As an 
illustration consider the presentation ol a 
variety ol leisure materials {e.g., blocks, 
record playei . viewlindet ). The tcaihn could 
ohseive and moid whiih materials wefe 
prcfcticd. how prolicient the individual was 
with the matetiah and lor what period ol - 
time he engaged in its use. Similai assessments 
might he made with outdoor lecreational 
equipment. The data collection sheet pre- 
sented eailier m Table 2 provider a means 
lor assessing dmVttions. 

The identification ol object preferences 
may be helplnl in determining the particj- 
pant's leisure skill prcfeienc'e; howcvei, it 
does not tell tin 1 leather what materials 
and/or activities to make available. Thcic- 
fou\ it is n ideal to relate appropiiatc leisure 
activities to the individual's specific educa- 
• lional and/01 habituation needs. 

Functioning Level find Specific Educational 
Nccdt 

The individual's functioning level will affect . 
the choice'ol mateiials ai v d activities wlrich 
should hi* provided lor assessment. Qui* 
sidejalion ol the individuals abilities across 
major curriculum areas cannot be ignored, 
hxprcssive and receptive language compe- 
tencies, line and gross motor development. 



and social skills must be evaluated in deter- 
mining which leisure skills u> target lor 
instruction, 

Initial screening of the student's function- 
ing level should teveal the behaviors in this 
'individual's ^repertoire And the behaviors or 
component skills which make up the leisure 
activities that aie targeted for injunction. A 
general parity or agreement between these 
two questions must be made in order for the 
leisure skill selection to be appropriate. 

Consider the following illustration. Susan's 
IKP indicates that at her pieseni performance 
level she is unable to attend for a period 
longer than three seconds, yet demonstrates 
competent line motor behavior (e.g., able to 
grasp and pick tip objects, push pull objects, 
scjuee/e, release and tianslei). She is usually 
withdrawn from others and stays in the corner 
engaging in high rates ol self-stimulation, 
i.e., twisting string or picking up scraps of 
paper from Moor and putting them in her 
mouth. Susan's teacher has provided a variety 
ol card and board games for Susan and the 
other students in the play area. However, 
Susan does not play appropriately with the 
games. Her approximate functioning level is 
not at parity with the skills icquircd in the 
board games. 

If the I IT committee has done a good job 
of initial assessment and instructional objec - 
tives have been clearly specified, then selec- 
tion of leisure skills may be facilitated through 
interrelating IF.P objectives with Icisnie skill 
goals. % . 

Physical (Characteristics 

In most cases, new behavioi can be developed 
ahd maintained itr individuals who are func- 
tioning at lowVlevelopinental levels. This is 
done through behavioral training techniques 
(e.g., Kazdi|i 4 1975). However, the partici- 
pant's physical characteristics will diicclly 
affect selection of leisure skills for institution. 
Individuals with severe motor impairments, 
extreme spasticity, or uncontrollable seizures 
present additional problems in the identifica- 
tion of appropriate leisti re skillsTor instruction. 

Even though such physical disabilities arc 
rareK- reversible, they need not intcrfeic with 
leisure skill piogramming (Williams, Hriggs, 
& Williams, I Q7l>). For example, the-child 



54 / Education and Ttainmg of the Mentally Retarded-f ebruary 1980 



with spasticity in arms and hands might enter 
into a game of moving a ping-pong ball back 
and forth through use of a head pointci^ 
This same skill might also facilitate scanning 
and head pointer conirol on a communication 
board. Another illustration might involve 
using oversized pieces in a table game for the 
spastic child who is unable to use standard 
size materials (March ant & Wehman, 1979). 
The adaptions are endless and require only u 
a teacher's creativity and an occupational/ 
(.physical therapists knowledge of motor de- 
velopment (Williams et al., 1979). 

^Ige- Appropriate Level o/^ Skill 

Another, variable which must be considered 
in the assessment and skill selection process 
is how age-appropriate the skill is. The princi- 
pal question to consider is, "Would a nonhandi- 
capped individual'of comparable chronologi- 
cal age engage in this activity during free 
time?" Severely handicapped adults on the 
Hour pushing a toy truck around or playing 
with a dollhouse are examples of inap- 
propriate skill selection. 

There is, unforttmau ly, limited empirical 
research on leisure skill programming with 
severely handicapped adolescents and adults. 
Il would appear, however, that the answer 
to the age-appropriate problems can be 
found in a detailed breakdown ol the skill 
into very small behaviors. For example, the 
prospect of teaching plant care to a severely 
or profoundly handicapped individual may 
appear remote. However, if plant cai;e is 
divided into several skills (e.g., putting dirt 
in pot, putting flower in dirt, etc.) and each 
skill is task analyzed, then learning problems 
will be reduced. 

Access to Materials and Events 

The most capable individual will have dif- 
ficulty engaging in a variety of leisure activ- 
ities without access to materials or events. At 
the least, transportation and some degree of 
financial resources are involved. The follow- 
ing question must be considered, "Can the 
participant get to community events, and if 
unemployed, does he ot she have the money 
\o make necessary purchases?" Although lei- 
sure activities can be engaged in without 
money (i.e., building a snowman), usually 



some funds are nctcssai) for the new male- 
rials and replenishing old materials. 

Thei e are othei factors hi consider as well. 
For example, initiating a social encounter 
may be difficult without knowledge of how to 
use a telephone (Nictupski K Williams. 1971) 
or if no phone is available. Interaction with 
toys or other play objects at home will be 
difficult if they^e stored away in a closet or 
have been destroyed with no funds to purchase 
new ones* Similarly, many resident* in stale 
facilities have difficulty o|KTatiiig the television 
or stereo which is placed eight to 10 feel 
above the floor. 

In short, ;i, careful assessment of what lo 
teach must include a look ai the amount and 
type of materials available, the proximity and 
physical design of local recreational facilities, 
the ease of transportation, and the availability 
of skilled recreational personnel to provide 
training. An analysis of these variables will, 
at a minimum, facilitate a decision concerning 
how broad a program to establish. It will also 
help identify what areas need more adaption 
and planning. 

Home Environment 

Perhaps the most critical factor in leisure- 
skill selection is evaluation of the home and 
neighborhood environment. The age of the 
individual's parents, the presence of siblings 
or other relatives in the home, the type of 
home, and the attitude of other home members 
will greatly influence the variety and inde- 
pendence of leisure activities. 

Location qf the home will also affect the 
selection process. Urban living presents dif- 
ferent problems than spai selylpupulatcd rural 
areas. Sensitivity of local (ommuitilie* and 
neighborhood members to bandit apped 
persons will also be reflected in the amount 
ol filttds which are appropi iated for thera- 
peutic ret reation programming. In "I able 3 is 
a checklist of f actors to consider in evaluating 
the home^ environment for leisure skill 
selection. 

The willingness of parents and other family 
members to follow through on school training 
programs is important as well. Marchant Und 
Wehman (1979) lound that demonstration 
and behavior rehearsal with a foster mother 
of a severely retarded child was instrumental 
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TABLE 3 
Client Home Environment 



I lie partit ip.tni lots with , 



Relationships and ages of othci persons in home. 



llow docs the participant utilize his lice lime at home? 

Dors the purtiiipaul ntili/c his leisuie lime indcpi n<lenily or with assistance in ihe home? 

WIi.ii leisure activities and ink rests a?r enjoyed h) others in home? 

I low many hours per day do hooscmatcsAiblin^s s|>eiiH with pailnipaut? 

Do housemates base any mutual (e.g. athletMs. musical ability) or Icaincd <c. K . (ookin K . tools) talents? 
Mow is the participant pciceiu-d hy mm*cH and In l.iini!>; meml>cis? 

Wh.it me the present attitudes towaid recreation and leisure held hy die p.unYipant's family members? 
Does the participant reside in an urban or jural aiea? * 
What Mbe attitude olth^ 

Dnrs the participant interact witXothris in the neighlxn hood? - 



in f4<*nri;ili/itty; table ^amc skills\frnm the 
classroom to the home, Pateut/piolessicmal 
partneiship is vital to maintenance of leisure 
activity i r pet toil c in severe!) handicapped 
individuals. 



Summary 

T he put pose ol this paper has been to de~ 
m tibe srvc a i.il l\ pes o( leisure skill cotnpctciu y 
at'eas whuh (an Ik* assessed in sevetclv 
handicapped individuals. These included the 
fno/ufnuy with which objects 01 matciials 
\seic- :t-iift:iK</<l- ihv Inigih tif sell -initiated 
anion, matetiaN pnfnnue hy clients, and 
hctpiency and dhc'tmn ol wial intnactmm. 

In the sec ond hall ul the attkle. guidelines 
lor selecting leisure skiljs were presenter). A 
variety of ateas ueie identified as critical to 
the skill selection ptocess. Client pteleic-iue 
for tlitlercut materials, f'uuctionin^ level, 
;u;e-;ipptopi iatettcss of acti\ii\. and support 
nl the home environment wcte amou^ t ho 
principal trilciia dusters. 

When these assessment atid skill selection 
guidelines :uc ptovided in conjunction with 
logically secpiencc-cl rec i eat ion ctmienhtm and 
insti in ttonal lechunlogy. the application ol 
the systematic instruction process (Web man 



8c NM aughliu. in press) to leisure skill 
development is complete. What remains is 
the continued development, field-testing, 
and validation of leisure skill rurrioda. I he 
items scc|tieucccl iYi these ctiirietila will then 
serve as appiopriate miciinn-ielcienced 
skills for assessment. 
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INFORMAL ASSESSMENT OF 
WRITTEN EXPRESSION 

■ • . i *■ 

J ames A. Poteet 



/\bs tract. This article presents an approach to informal assessment of written ex-, 
predion which allows thejteacher to determine (a) the skills acquired and correctly 
used by the student, (b) the skills needing remediation, and (c) the skills to be ln« 
troduced. A Checklist of Written Expression Skills Is provided 99 an aid In this In* 
formal assessment procedure. Results of the assessment are directly related to the 
Instructional objectives and annual goals In the student's IEP. Written expression 
and Informix! assessment are defined and development of the language system Is 
discussed. Data required by the teacher prior to Informal assessment are described 
as (a) the broad spectrum of written expression skills, (b) requirements of the 
specific writing task being assessed, and (c) student characteristics related to the 
student's language system. 



Informal assessment Is an invaluable aid for 
a learning disabilities teacher both In dally 
teaching and In providing diagnostic Informa- 
tion as a member of the evaluation team. 
Results of Informal assessment assist the 
teacher in deciding what specific skills to 
teach. This -article will focus on the Informal 
assessment of written expression. 

Written expression can be defined as a visi- 
ble representation of thoughts, feelings, and 
ideas using symbols of the writer's language 
system for the purpose of communication or 
tecording. 

y A person's language system develops 
hierarchically beginning with Inner language 
acquired by the association of a variety of ex- 
periences with words (Myklebust; 1965)/ 
Maturity |r> language development fs achieved 
by the s&qucntial development of (a| ideas 
through experiences and thought, (bj com- 
prehension of the spoken language of others 
through listening , He) oral expression of ideas 4> 
to others by^Use of spoken language; (d) 
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reading of the written language^nd finally 
(e) written expressKm. In other words, ex- 
pression Is the l3||^t^ge of the language 
system to develop; it is ti^jhly complex and 
requires the Integration of all previous stages 
(Myklebust, 1968). 

Prior to Infprmal assessment of written ex- 
pression, the teacher nAist posses? thefollow- 
Ina Information: 

a. broad spectrum of written expression 
stalls. 

2. requirements of the specific writing task, 
and 

3. characteristics of the student being 
assessed as they relate to the develop- 
mental nature 6f the "student's language 
system, '% 



JAMES A. POTEET, Ph.D., fs Assoclot&Fro- 
fessor^ of Special Education, Ball State 
University, Mundg, IN. 



The broad spectrum oj written exprea- 
t§lon skills. The teacher must know the 
scope of necessary skills which comprise Writ- 
ten expression (see Figure 1) as well as the se- 
quence In which they are taught. By compar- 
ing samples 9f the student's writing with a 
scope-and-sequence chart, the teacher can 
determine which skills the student has and 
has not yet acquired. Knowing the sequence** 
In which writing skills should be ta'ught, the 
' teacher can determine which unknown skills 
should be Introduced first and- how to 
prioritize the skills that need remediation. 

The language a1f^tex|book in use hy the 
local school district Is usu&lly the best scJUrce 
for such a scope and sequence of s^Hls. 
Possibly, a local ciy^j)um*fluide has 
developed whlch^Jgives ^directions for skills 
development by gradg level. If such materials 
are not available, an excellent scofrc-ajtd- 
sequence chart for grades on^ through eight 
is provided In HammiH and Bartel 0978, pp. 
x 186-191), andior grades one-through twelve 
In Poteet (1980kj ■„ ; 

By viewing th^p^rum of wrlt»^e^pre^ \ * 
slon as being comprised of components, each v , 
with uplque elements, the teacher cap more 
easily structure "both assessment and Instruc- 
tional practices. While a variety of com- ^ 
ponents have been conceptualized (McCrim- - 
mon. 1973; Hodges & Whltten, 1977), the 
following components and their elements 
allow the teacher * t<^r approach Informal 
assessment in h systematic way: 

I. Penmanship 

II. Spelling 
HI. Grammar 

IV. Ideation « 
1 Penmanship concerns the* legibility of 
writing. Handwriting quality is the focus in this 
component. The spacing of the writing on the 
total page, the spacing of sentences, Words, 
and letters, slant; letterlormations, pressure 
on the paper, and pencil grip are Important 
elements of penmanship quality to be con- 
sidered. % • ^ * 

II. Spelling. Words Incorrectly spelled and 
nonrecognlzable "words" .are considered 
under this cpmponent. Error patterns might * 
. be characteristic of the misspellings and will be 
discussed later, in the Informal assessment 
discussion. The percent of Incorrsctly^spellcd 

0 



words can guide the teacher In determining if 
a remediation program is necessary for the 
student being, assessed. Elements to consider 
urrder this component are miscalled rules, let- 
ter Insertions, omissions and substitutions, 
pKomhic spelling, directional confusion, 
schwa end r-controlled vowels, letter orienta- 
tion, and sequence. ' 

ill. Grammar deSIs mJth the accepted rules 
and conventions of wrftten expression as sepn 
In contemporary Am«rican-English\ It covers 
the mechanical, semantic, and • syntactical 
aspects of our written language and is divided 
Into: a. Capitalization, b^ Punctuation, and c. 
Syntax, each vVfth its own subelements. 

Subelements under Capitalisation specify 
proper, usage of capital letters as proper 
npuns, proper adjectives, first word in a. 
sentence, first word in a 'line of veise >N first 
word In a quotation, principal words in a 
literary title, personal titles, the use of 'T' and 
"O", personification, letter salutation, com- 
plimentary ending In a jitter, and possible 
other usages. Subelements under punctua- 
tion include uses of the period, comma, 
apostrophe, quotation marks, question mark, 
semicolon, exclamation mfark, colon, thfc 
dash, parentheses, brackets, and the Slash. 
Syntax, which concerns the relationships 
among words, has the following subelements: 
parts of speech (verbs: transitive, Intransitive, 
'active, passjve, past, present, future, In- 
finitives, gerunds as nouns, and participles as* 
adjectives; pronbuns; adjectives: articles, 
modifiers, predicate adjectives; adverbs; 
prepositions^ conjunctions: coordinating^ 
subordinating; interjections), agreement of 
subject and predicate', correct use of 
nominative, possessive, and objective case, 
pronoun reference, orjter and' position of 
words and phrases (dangling fnodifiers), 
parallelism, the use of abbreviations and/or 
numbers, and the, paragraph (cohesiyjeness, 
topic sentence, transition sentence). 

IV. Ideation concerns the thoughts and 
Ideas the writer h&s at command while 
writing. The writer must have some Idea to 
^express or to convey. The content can reflect 
varying levels pf absfract thinking, creativity, 
and emotional "quality. Word -choice c^n 
render the writing from trite to spellbinding. 
Effectiveness often hinges on 'the productivity 
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CHECKLIST OF WRITTEN EXPRESSION* V 
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C. Spacing of the words 
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D. Spacing of letters 
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II. SPELLING 
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E. Phonetic spelling ' * 
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. : r ■ — . : yj 

— . 1 . „:*. t u.< f J 


H. Letter orientation 










■'■■■m 


I. Sequence 










— : a ; 1 


J Other 










■* • • . • • . . - %■] 



90 . Iteming DiKtNhty Ouarf«r/v 



ERIC 



■tr: 



98 



tt~ : ! r 

Figure t 

CHECKLIST OF WRITTEN EXPRESSION (Continued) 

i . ...... f 



Ml. uRAMMAR 
A, Capitalization 
- 1. proper noun 


TA 


A 


i 


R 


Notes 










* 


1 2. proper adjective 












3. first word In ft sentence ? \ 












4. first word in a line of verse 












. n. first word In a quotation 












1 O- principal words in a title 












/. personal title 










/«- 


». iiM of i or tx 












*f. penonnicauon _ 












iu. salutation in a letter l 












11/ complimentary close in a letter 












^\ - lz other 




t r 








B. PunrtuaWon 

1 period 


# 










* 2. comma 










- 


- 3. apostrophe , 












4. quotation marks 












5. question mark 












» * - ^ C0mlfrilr\n ^ 

* vJ. sts iiiiccjioii rr 












v ♦ * " J - 7 evrbimMion mark 

■* * - caluji iiui iui i main 
























**-* Q thorlach 

-7* IIIK UllMI — T 






















r- 


\ 3 11 hrarkolc 




♦ 








19 fhM cUcK 












'v ! C, Syntax " 

1- pArts of speech "v '. 

: v - * a. verhs 


- 


- ,,- ■ ■ 


: — - 


i 




b. nouns r 












c. pronouns 












7 - .* . . d. adjectives 










o 


• y . e. adverbs ' 










o 


.v s ' f. prepositions . ■ 












* -V q. conjunctions v 












h. Interjections 












2. agreement 












■A 3. case . • ' * 












.4. pronoun reference 












'i 5. or/der/posltlon of words 












6". parallelism 












\ J ^ . 7. abbreviations/numbers 












\/. : :l 8. the paragraph 













< - • - • 

Vp/um* 3.FoM990 91 



99 



Flflure 1 

CHECKLIST OF WRITTEN EXPRESSION (Continued) 



IV. IDEATION 

A. Type of writing 

1 I. story 2. poem. 



3. letter. 



4. report. 



5. review^ 



B, Substance 
1* Naming. 



2. Description. 



3, PloL 



4, Issue. 



C, Productivity 

1. Number of words written^ 

D. Compref\ensibillty 

Easy to understand ^ 



2. Acceptable number. 



3. Too few„ 



E. Reality 



_ Difficult to understands^— 

^ perseveration of words 

' .perseveration^ ideas 

^Accurate perception of stimulus or task 
Jnaccurate perception of stimulus or task 



Cannot understand. 
__jlloglcal 



i_disorganized 



F. Style 

1 . Sentence Sense 

a. Completeness 

(1) . complete sentences 

(2) . run-on sentences 

(3) . sentence fragments. 

b. Structure 
(1). simple. 



Tallies: 



(2) . compound 

(3) . complex 



(4). compound/complex, 
c. Types 

(1). declarative L, 



(2). interrogative .; 

(3J. imperative " _ 

(4). exclamatory , 

2. Tone 
a. Intimate^^^ b. friendly 

3. Word Choice (N = non<e,F = few, S = some, M » many) 

a. formality J # 

formal InJ&rmaL colloquial 

b. complexity ^\ 

simple__ k multisyllabte„__ contractions.! 



c. Impersonal 



c. descriptiveness 
vague. 



vivid. 



d. appropriateness 
Inexact 



figures of speech. 



xact \^yrds_ 



superfluous/repetitions. 
+ 



omissions. 



< • Adapted from The Inventory of Written Expression and Spelling (Poteet, 1980). 
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level of the writing; ar&enough words used to 
adequately represent me ideation ^underlying 
the content? Elements within this component 
to consider are: a. Type of Writing, b. Sub- 
stance, c. Productivity, d". Compre^ensiWity^ 
e. Reality, and f. Styles 

Five major types of writing are taught in the 
schools'each with its own requirements for ef- 
fectiveness. They*are stories, poems, letters, 
reports, and reviews. Stories are the most 
familiar to students and are probably th<? 
easiest of all types of writing to produce. 
Often story starters such as pictures or a tppic 
sentence are used as-motivatofs. Poems as" 
well as stories require creative skills, an&they 
are often structured according to topics or 
•style. Writing of business and friendly letters 
Is taught in the elementary grades. Reports 
. which make use of factual information can 
range from a simple telling about a vacation- 
trip to a detailed scientific or literary rep^ftt 
often assigned in the upper grades. Reviews^ 
consist of personal opinions about books/ 
movies, TV shows, plays;' oY musical perfor- 
mances. 

Substance concerns the abstract quality of 
the writing which can easily be categorized In- 
to the following four abstraction levels: (1) 
Naming, (2) Description, (3) Plot, or (4) Issue 
(Poteet, 1980). If the writing task is to write a 
story about a picture, then in level one, the 
writer essentially lists objects or people in the 
picture ('1 see a fire engine, a ball, a. house, a 
man, a tree, a car"). Such writing is 
analogous to oral expression of labeling, a 
rather Immature form of communication. 
Level two, description, is illustrated by an ob- 
jective jreporting of the content of a picture ( t4 t < 
see a man. The grass is green. The bus 4 i$ 
blue. The girl is running. It is raining."). Level 
three which represents a plot is a completed 
story about the picture however short or 
poorly expressed*. Level four goes beyond a 
simple plot to deal with some moral theme or 
issue. 

Productivity, the number of words written, 
\s an indicator of maturity in written expres- 
sion with more words written as the student 
grows older. Hermreck f 1979) found that' 
no'n-handicapped students writing a story 
about a picture selected by the teacher, wrote 
an average of 83 words in grade three, 94 



Words In gratlte four, }41<words in grade five, 
and 200 words in grade six. She also found ' 
that learning disabled students wrote an 
average of 40 words in grade three. x>4* words 
In grade four, 70 words in grade five, and 170 
words in grqde six. Consequently, it seems 
that learning disabled students write fewer 
word's than . their non -handicapped peers 
(Hermreck, 1979; Myklebust, 1973; Poteet, 
1979). Some writers simply do not use 
enough words to give'thej^acfer a feeling of 
completencssfabout what is read. In some \\\:4 X 
stances, words are obviously omitted and in 
other Instances superfluous words distract 
from the continuity pf the writing. 

Comprehensibility is concerned with' the 
ease 'of understanding what the student 
wrote. Reality assesses the accuracy of the 
writing which must reflect a realistic percep- 
tion of the stimulus or . of the writing task 
Style is the unique way a piece of writing is 
written. It is highly related to the purpose of 
the writing (McCrimmon, 1973). For 
writing to be effective, correct sentonce^sense, 
appropriate tone, and appropriate choice of 
'words are necessary; these are the elements 
of style. 

Sentence sense subelements to consider 
are: a. completeness as observed in complete 
sentences, run-on sentences, and sentence 
fragments; b. structure as observed in simple, 
compound, complex, and compound/corn- 
plex sentences; and c. types of sentences as 
observed in declarative, interrogative, im- 
perative, and exclamatory sentences. The 
tone of the writing can be described in rela- 
tionship to the distance the writer establishes 
between himself/herself and the reader. The 
wnting can be described as intimate, friendly, 
or impersonal. 

The emotional quality of writing is best 
assessed by inspecting word choice, 
sometimes called "diction 1 '. Words can be. 
analyzed in terms of formality, complexity, 
descriptivefiess, and appropriateness: Words 
have been described as foVmal ("to depart"), 
informal ("to leave") , and colloquial ("to 
split"). Some words can be quite complex 
c'onsi^Jirrtj of several syllables while others'are 
simple, short,, or contractions. Descrip- 
tiveness of the words can range from concrete 
(Benny Goodman) to abstract (musician). 
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Descriptive ^vor^ls can relate to the senses of * 
^touch (sandy), taste (salty), smell (pungent), 
(sound (hissf, or sight (flicker) (McCrimmon/ 
1973). Some writers use $uch vague words 
arid tTite expressions that the reader is left 
vwtb uncertainty about the writer's intent. 
]jne$e writers use words such as 4 all that 
stuff*', "and all", bnd "everything like that" 
Words may also be" vivid afid exciting; they 
also may illustrate figures of speech. Ap- 
iprbpriatPYiess of word choice demands that 
the exact words or idioms be used (not '1 ex- 
icpt your Invitation' 1 ), that superfluous words • 
and useless repetitions not be used, and that 
necessary words not be omitted. 

When all of the above four major com- 
ponents and their elements have been ana- 
lyzed in a written expression sample, a com- 
prehensfue assessment of the broad spectrum 
of writing skills will have been conducted.* w 
Comprehensive informal assessment must be 
viewed both as (a) holistic, all components 
are considered as integrated into one com- 
plete whole, and as (b) atomistic, specific 
skills or elements of the components are con- 
sidered. as the bits anjl pieces which are com- 
bined to construct the final product. 

It is not necessary to employ all elements of 
the assessment for every student being as 
sessed. The more advanced skills understan- 
dably have not been acquired by the younger 
students and should not be considered during 
assessment. The severity of the studenfs 
learning disability, the skills which have been 
taught, and the curriculum appropriate to the 
student's grade placement must be con- 
sidered when assessment is conducted. The 
earlier skills are of primary* interest for the 
younget or the more disabled student while 
the more advanced skills would be ap- 
propriate for the adolescent and young adult 
or the less disabled student. For the teachers 
who might n^d to review the complexities of 
written expression, the Harbrace College 
Handbook (Hodges & Whitten, 1977) offers 
an excellent overview. / 

The requirements of the specific 
writing task. The teacher nrfust consider tne 
skills necessary and appropriate to the specific 
writing task that is being assessed. While 
capitalization t and punctuation skills are 
necessary across all types of writing, word 
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■ choice and sentence structure would logically j 
be different In a friendly letter than in a formal 
report or would even differ between types of 
stories. By considering the task requirements 
before assessment, the teacher can establish 

' appropriate and fair expectations of skill use. 
Conversely, skills that are not appropriate ca/\ 
be Identified and not given consideration dur- 
ing assessment. Familiarity with the broad 

* spectrum of skills discussed above facilitates 
this process. 

, The characteristics rof the student. In 
light of the development of the language 
system discussed earlier, the teacher must be 
(familiar with the students characteristics as 
they relate to this development. Knowledge 
of the student s personal and educational ex- 
periences and interests can be used to build 
reasons for writing. Hearing acuity and Its, 
related listening comprehension skills must be 
known as well as the students speech pat- 
terns and use of oral expression. Dialetts and 
cultural influences affect the way students talk 
and often tyow they wnte. 
The teacher must be familiar with the stu- 

, 'dent's oral expression Many times, knowing 
how a student talks helps determine if the er- 
ror in .written expression should receive high 
or low priority for remediation. For Instance, 
if the student wrote "Are hole famly was 
washing TV one night 0 , one would seriously 
doubt the literal interpretation of the 
sentence. Probably, the Student actually says 
"watching".. If so, the error sujggcsts a recall 
error of graphically representing the /tch/" 
sound. Asking the student to read aloud what 
we*s written can also provide clues to the 
reasons for the errors. -V* 

Since one cannot write what one cannot 
read, a knowledge of reading skills is impor- 
tant. Knowledge of fine-motor skills can ex- 
plain the observed quality of the student's 
penmanship. Knowledge of the student's 
cognitive development can explain the level 
of ideation content in the student's writing. ^ 
An Approach to Informal Assessment in 
Written Expression 

Informal assessment is that set of pro- 
cedures designed to provide the teacher or 
diagnostician with precise answers to specific 

i questions not available from standardized, 
norm-referenced tests. The purpose of such 
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assessment Is to determine Appropriate In- 
structional strategies (or the student being 
assessed. Informal procedures are wot stan- 
dardized or norm referenced, usually do not 
provide a score, may be published or teacher 
' made, and usually describe the behavior 
rather than quantifying it. These procedures 
also may provide broad general information 
as obtained from an informal reading inven- 
tory or may pinpoint precise skills and error 
patterns suggested for remediation. 

While. Hammill and Bartel (1978) view in- 
formal assessment as 4, by far the most pro- 
fitable assessment procedure", they caution 
that the -method is only as good as the 
teacher's competency/ that the reliability of 
the teacher as an observer is always 
'unknown, and that the teacher's experience 
may not substitute for normative data. 

The use of informal assessment, however, 
does allow the teacher to determine what to 
teach and how to teach it. When using infor- 
mal assessment the teacher must always con- 
sider the student's educational history as well 
as the student's past and present curriculum, 
and the* students current grade placement \ 
To decide what to teach the teacher must first 
determine: 

(a) the skills acquired and correctly used 
by -the student - 
} (b) the skills needing remediation " . 

(c) the skills to be Introduced 

Skills acquired and correctly used can be 
determined by analyzing several samples of 
the student's writing over a period of a few 
weeks to insure that the student reliably 
displays the observed skills. A variety of types 
of writing, such as letters, reports, etc., as ap- 
propriate for the student's grade placement, 
should be inspected since the use of skills 
varies with the type of writing produced. The 
requirements of the writing task, then, will 
change the focus of the diagnostic inquiry. 

Skills needing remediation and skills to be 
Introduced are determined by noting errors 
and error patterns in the writing samples. 
Conceivably, any error noted on the student's y 
sample could readily be designated for 
remediation. A story written by a bright third 
grade student about an Intriguing mystery 
with much dialogue might indicate that she 
does not make use of quotation marks. By 



reference to a scope-and-soquence chart the 
teacher notices that quotation marks are 
typically taught at the fourth grade level. This 
skill then would not be considered remedial 
for this third grade student, but with an in- 
dividualized language arts program, the^ 
teacher could introduce this skill especially 
since the student uses dialogue in her writing. 

The skill to introduce might be a more ad- 
vanced skill in the sequence of stalls currently 
being used by the student; or it might be a 
"lateral expansion" of some current skill being 
correctly used. For instance, the use of tfie 
exclamation mark might be introduced to give 
variety to the type of sentences written and to 
generate excitement in the thematic material 
( M Wow! Would you believe it!?!"). A lateral 
expansion of some current skill migh! deal 
with word choice* not so much to develop a 
new vocabulary, but to use existing word 
knowledge to create sensory awareness and 
reader involvement ("The green slime oozed 
between his toes as he felt the prickly weeds 
* cutting his legs"). 

The decision as to which skill to rem^diatQ, 
or which skijl to introduce must rest with the 
teacher. To assist in this decision making, 
knowledge of the scope and sequence of writ- 
ten expression skills, the instructional pro- 
gram available to the student,, the student's 
aspirations, previous skills taught injthe cur- 
r riculum, the requirements of the writing task, 
and skills appropiiate for. the students current 
grade placement must allb<? considered. 

For the purposes here, the following ap- 
prdach to Informal assessment ij designed for 
use with a story written by a student after be- 
ing assigned by the teacher using some 
Stimulus as a story starter. Notations are made 
directly on the written sample for use by the 
teacher. The page of writing probably should 
not be returned to the student; a large 
number of marks could be overwhelming. 

The approach to analyzing the written sam- 
ple will follow the sequence outlined in the 
Checklist of Written Expression (see Figure 
1), Beside each entry in the checklist, place a 
check mark in one of the four Columns which 
best describes the student's achievement in 
written expression in tHe first three com- 
ponents. The far left column (labeled u TA n ) is 
. for those skills or characteristics which the . 
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teacher decides pre too advanced tor con- 
sideration 'at this time or are not appropriate 
to the, writing task being assessecj. The next 
column (labeled "A") is for skills that are adc- 
quQtdy used in tlie sample. Skills, checked in 
these two. columns do not require the 
teacher's attention for instruction at this time. 
The next column (labeled T) b for those 
skills which need to be introduced to Improve 
the qdality of the student's writing. Typically, 
they are not observed in the students writing. 
The last column (labeled "ft") Is for those 
skills which need remediation or review, 
These skills are used either incorrectly or in- 
consistently. Skills checked in these last two 
columns require the teacher s immediate at- 
tention for instruction. To the right of the four 
columns is space for writing specific errors 
which need to be remediated or for brief notes 
regarding instructional planning. 
• Before assessing the students written sam- 
ple, the teache'r might scan the checklist and 
determine those skills which are "tod ad- 
vanced for consideration at this time" or 'foot 
appropriate to the writing task" and place a 
check mark in the column labeled "TA" 
beside those skills. All remaining entries on 
the checklist should be- inspected in the writ- 
ten sample. 

Once the student has completed the writing 
task the teacher should ask the student to 
read aloud what was written and should note 
any deviance from the written sample (Zig- 
mond. 19761. This procedure helps the 
teacher deciphering misspelled and 
unrecognizable "words". Now the teacher 
should begin the careful and critical analysis 
of the written sample, component by compo- 
nent, using the checklist. 

I. PENMANSHIP. First, obtain your overall- 
impression of the quality of handwriting. Rate 
ft from 1 (It's a mess!) to 5 (Beautiful!) and cir- 
cle the Tating number found on the checklist. 
Then, notice jhe use oU space on the page, 
spacing of sentences, spacing betweenwords, 
and finally spacing between letters. Next, 
determine if the slant is appropriate. Then 
look at the letter formations, but always in 
light of the penmanship curriculum. Notice if 
the poor quality of formations suggests a 
combined use of upper- and lowercase let- 
ters. Then analyze the types of letters showing 
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poor quality. For instance , Inspect the short 
round letters thq| begin alike (a, c, o, etc.), 
the tall letters (I, k, t f etc.), letters easily 
reversed or rotated (p. b, d. q, m, w, n, u), 
letters tljat go below the line (g. ), p, q, y), 
and slanting letters (v, w). Othx*r patterns 
might be equally Important depending on 
whether manuscript or cursive is used. Write 
the specific letters needing remediation on the 
checklist In the space provided.' 

For those who like visible examples, the 
Zaner-Blose Evaluation Scales can provide 
samples of varying degrees of quality 'for 
grades ;one through eight which can be used 
for comparison, or even for scoring, pur- 
poses. However, the best comparison is with 
the students classmates. Collect from all 
students a saffi^le of their* l^est writing of the 
same sentence. Divide we samples into five 
stacks rated "poor". M fahf\ "ayerege 1 \ "very 
good", and "excellent". Divide each of the 
five stacks into five stacks similarly classified. 
Continue in this manner and eventually 
choose the best representative of the 
"average" classification in each of the original 
fitfe categories. With these five representative 
Samples from each classroom, an individual 
student's written expression sample can easily 
be compared and judged ■i$*"po6r ,t to "ex- 
cellent". Students whose ovferall quality Is 
ranked as "poor" df "fair" q>n the checklist 
should receive a remediation program for 
penmanship skills. 

II. SPELLING. Underline all misspelled 
words on the written sample and determine 
the percentage of misspelled words by 
dividing the number of misspelled words by 
the total number of words written. Decide at 
what percent of misspelled words an intensive 
spelling remediation program should be im- 
plemented. Analyze the misspelled words to 
determine if some sort of error pattern Is con- 
sistent. Many spelling errors result from con- 
fused recall of spelling rules. Others are 
related to insertion of unnecessary letters 

. (umberella for umbrella), omission* of 
necessary letters (famly for family), substitu- 
tion of letters (mush for must), phonetic spell- 
ing (sed for said), directional confusion (wa£ 

ft for saw), schwa and r-controlled vowels (tabel 
for table; doller for dollar), orientation confu- 
sion of letters (djj.p.q^u.m.jv), sequence 
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(amlnals far animals). In the space provided 
on the checklist, tally the types of errors made 
In the misspelled words so that the frequency 
of the errors can be discerned. Then deter- 
. - 7 mine which error patterns need ^mediation 
and check th6 remediation column beside 
those errors. Write those words that are fre-- 
quently used and misspelled as they should 
receive immediate attention. 

II!. GRAMMAR. A. Capitalization. 
Capitalization errors are easy to spot, Circle 
the errors on the< written sample. Capital let- 
ters are either omitted Or insetted where they 
should not be used. Ih the space on the 
checklist write "om" for omission or "in" for 
Insertion beside the entries each tinYe an error 
is observed. This information will show the 
. teacher the types of capitalization errors made 
and Ihe frequency of such errors, The ap- 
propriate column should then be checked. 
B. Punctuation. Follow the sam6 procedure 
with .punctuation errors as was used with 
capitalization errors. Determining capitaliza- 
tion error is relatively straightforward, but 
determining punctuation errors is less precise. 
There is a wide divergence of opinion regard- 
ing the proper place for a comma. The 
teacher can only inquire about the most cur- 
rent use that is part of the student s contem- 
porary curriculum. C, Syntax. To judge the 
written sample in terms of syntax, inspect the 
use of each of the subelements listed dn the 
checklist. Determine if the appropriate parts 
of speech are used and used correctly. Is 
there agreement between the subject and the 
verb In each sentence? Is the appropriate case 
used? Are pronoun references clear? Do 
dangling modifiers or unusual word order 
detract from the meaning of the writing? Has 
parallelism been effectively used? Are ab- 
breviations and numbers inserted incorrectly 
within sentences? Dpes the paragraph contain 
a major idea and [s it cohesive? Do the 
paragraphs have a topic sentence — not 
necessarily the first sentence? Do they have 
transitional sentences? Dp they flow logically 
- in the correct sequence? Does the writing 
have an introduction and some type of logical 
conclusion? 

IV. IDEATION. A. Type o/tvrit/ng/Check 
the entry on the checklist that describes the 



type of writing being assessed. B. Substance. 
If the type of writing Is a story, check the level 
of substance reflected in the writing, other- 
wise omit this section. C. Productivity. Simply 
count all the words written and record ihe 
total on the" checklist. Check if the number of 
words whiten ate appropriate for the 
student's age and grade placement. D. Com- 
prehensibility . Is the writing easy or difficult to 
understand? If it is,difficult to understand or if 
it cannot be understood, describe ihe difficul- 
ty in ihe space* provided after checking any 
descriptor on the checklist that might be ap- 
propriate. E. Reality. Does the writing reflect 
an accurate perception of the slimulus or of 
the writing task/assignment? F. Style, (a) 
Sentence sense. After reading each sentence, * 
place a tally mark in each of the three sections* 
(a. Completeness, b. Structure, ancl c. Types) 
on the checklist under Sentence Sense lo 
describe that sentence. For instance, one 
sentence may be checked as complete, sim- 
ple, and declarative; while another might be' 
checked as complete, compoifid, and inter- 
rogative. A tally of those descriptors for each 
sentence reveals a visible record of the variety 
and types of sentences used. With this infor- 
mation, the teacher can more easily decide 
those aspects of sentences which need tp be 
remediated or introduced. Since the four col- 
umns are not used in the Ideation compo- 
nent, circle fhose elements which should be 
remediated and writer '"Introduce" beside 
those to be introduced to the student, (b). 
Tone. Determine the level of .the tone used in 
the writing and note it with a check mark on 
the checklist. Most writing is described as r^V^: 
friendly. An intimate tone makes use ot fre- 
quent personal pronouns while an impersonal 
tone is found in formal reports, (c). IVord 
choice. Notice the types of words the student 
used in the written sample. Word choice is 
strongly influenced by the type and purpose 
of the writing, 'Designate the quantity of the 
types of words used in the writing by marking 
B W for none, M F M for few, "S" for several, 
and l4 NT for many beside the descriptors on 
the checklist. There are three descriptors 
beside each of the subelements of formality, 
complcxily, descriptiveness. and ap- 
propriateness. Circle the descriptors which 
suggest the need for instructional attention. 
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f or instance, a teacher might put an M N ,r 
beside the descriptor vivid in a rather dull 
piece of writing and circl? jt a$ a reminder to 
teach the use of more colorful words. » 

Where Do You Go fromhere? 

By now the teacher should have a com- 
prehensive analysis of the student's written- 
sample. Specific skills to review and to 
"remediate are checked and new skills to in- 
troduce have been determined. How does 
the teacher prioritize the skills whjeh have 
bfeen selected for instruction? While each 
teacher will have his/her own preferences, 
one approach to determining which skill to 
tench first can be found by reference to a 
scope-and-sequence chart. Skills taught in 
'grade** one might receive priority oyer skills 
taught in grade two. For the adolescent the 
priority skills should relate directly to waiting 
skills requlre'd for career opportunities and 
daily living such as job application, check 
writing, test taking, outlining, report .writing, 
etc. (see AJley & Deshler^l979), 

Given the set of specific skills targeted for 
remediation and introduction, the teacher 
should list them by priority In sequence for in* 
structional planning. The most important 
skills should be taught first, and they should 
be the majof instructional objectives on the 
student's individualized education program 
\1EP). ' „ , 

Informal assessment conducted by profes- 
sional educators will yield results which *sug- 
.gest Instructional , strategic? that aye more 
educationally relevant and instrufctjonally ap-. 
propriatc than strategies selected by a variety 
of other diagnostic approaches. When you 
consider that the student s teacher has the 
primary responsibility for instruction, 
shouldn't the teacher also have the primary 



. responsibility for determining what Is' to be 
taught? ^ 
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Assessment of Applied Academic and Social 
Skills 



Ah\Um t iwcwmcnt of lelrvnnt m ndemk and social \kith of dcvelopmrntalh d\\aMcd*adide\ccnh or.young 
adults would sccty to be ma\f (ffectivfif dnnr .in the context nf an applied in preVocatwnal setting. An 
'awrwmrnt in^trunfcnt was dei'htfied to measure applied wading and comprehension skills, dnvctimi fol- 
lowing fusing information ftow thr rending passages), applied number skills, and social adaptation to a 
xemk \ttunf\mu (.'<jw/""' w '" "/ srores of 10 developmental disabled adolescents with their levels on 
comparable tests of ailueycment nw mwy/ a* d preliminary meautrcjtj the validity of this instrument. 



Noi only have developmental!} disabled per- 
sons gcucfrHv been shown to hold jobs tc- 
cpming less skill (Ric hardsom 1978), hut s|x*- 
c if ic training is often necessary for them to 
reach their potential in both work and Ici- 
sme situations (Clark. MWMI-, Msiiinn. 1979). 
The systematic assessment of work skills and 
woi k-rclaicd .sorial comix'tence has there - 
foie become :i matter of serious concern, 
particularly given recent emphasis on voca- 
tional education of I Ik 1 ha,ndicap|>cd tinder 
Public l\w 91-142 (Bellamy, Wilson, Acller, 
* Clark j WHO). 

Recent appiciac he* have tended to cm- 
ph.iM/e assessment of a \ariety of cognitive 
and social skills deemed essential to voca- 
tional sou ess. Qumoncs (!97K) has; exam- 
ined the use pi a standard psychological bat- 
ten of tests and loiind thrtl ac hievement test 
measures were among the" best predictors. 
Sihrcincr (I97K) also found that measures 
o1 cogiiiuve,abihly wc.tr related to work |>cr- 
lonnantr but that samples of behavior nu- 
clei actual work conditions were among.the 
W\X pieclictors of work success, ancl task 
anahsis has been fa voted as an effective 
means of vocational assessment (Kriedrn- 
beig * Martin. 1977). Personal independ- 



ence has likewise been cited as a good |>»c- 
dictor (Cunningham K: Picsnall. 1978), as 
have verbal manners and < omimtukaunn 
skills. es|K % cially when these are considered 
in relation to the appmpiiaieness of a dc- 
vclopmrntally disabled peisoifs job assign- 
ment (Malgady..llarchri. I owner. Sc l>avis, 
1979), Kxemplaiy progiams of assessing a 
handt<apj>cd person's work potential by ob- 
serving his oi h< r response to actual job 
tiamini* have also been developed. (Bellamy, 
I It lriHTp '& I ti lm-ii. 1^9: t -old. 1973). These 
appear to have the advantage of more im- 
mediate generalization of results to actual 
work situations. 

Much in tbe.se findings points to the wis- 
dom of assessing a dcvelopmentallv disabled 
| km son's voc ational potential by evaluating 
bis or her acadrmic, and, social skills within 
the context of a work-related situation. Con- 
versely, there also seems much to suggest 
that instruction of h^ndic appecPstudeots. 
whether in regular or social classrooms, 
should be increasingly ♦carried out with a 
view towards application of their academic 
.skills. The generalization of skills learned in 
a classroom setting rnav then Ik* less .prob- 
lematic ivhen these sfflls eventually have to 
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1^ applied to actual work or leisure' situa- 
tions <H.»l|Hm, l<>7!>; Pouei. lilH»: Sioil- 
den. (labile, and Schw,ut/, l J .>77). 

The present study is a report on die de- 
velopment of nn instrument to assess applied 
academic and social skills, plus an analysis o! 
data on die concurrent validity of the insti u- 
nicni M^d for 1 1 lis technique. 

The instrument, hereinafter referred to 
as the "Applied Assessment IntttumciU" or 
AAI» was developed whliin i he context of a 
picvfK ational shop classroom foi develop- 
menially disabled adolescents hospitalized 
lor psychiatric disorders and has been used 
for the past two years to evaluate t.he read- 
iness of these students lor various prevoca- 
tional or hobby activities. 1 Tlje AAI was not 
only intended to be applicnnliMo a variety of 
provocations! situations for dcvclopmcntally 
disabled adolescents and young adults bin 
also to ser\e as a model lor fmlhmk to class- 
room teachers on handicapped students' 
ability to apply the academic and social skills 
learned in regular or s|>ccial classroom set- 
tings. Results aie therefore used not only to 
assess the student's academic and social 
readiness to function in various simp activi- 
ties but, just as importantly, to pioude data 
to the student s concurrent classroom teach- 
ers on any prevocational academic com la- 
tencies which the student does not yet seem 
to have master ed.' 

AAI is designed to assess reading, num- 
ber, social, and utot or skills using materials 
taken from typical woik or hobby projects. 
These will Ik: discussed in more detad. The 
present study includes a comparison of the 
scores of development allv disabled adoles- 
cents on five.nreasof the* AAI (applied read-^ 
ing. comprehension, direction following, 
number skills, and social skills) with their 
subtest scores on the California Achieve- 



'The instrument developed for ihis technique 
is the "Assessment of Applied 'Academic and So- 
cial Skills" of the UCLA NTl (Neuiop ? \thiaii ic 
ItiMinne) School Pi evocsn ional Shop Clatsironm, 
The title has been shoitenctl for convenience 
herein. Sample copies of the. insriumeiu ,md ac- 
companying answer and summary rcpon sheets, 
as used in the NIM School, are a\ a liable without 
charge and may jjc obtained by writing the au- 
thors. V t_ 



mem "l est ( Tiegs Ik CLuk, l!MiS) in reading 
wxahuhuy. comprehension, arithmetic tea- 
soniug, and arithmetic lundamcuials an/I" 
With a beh.oioi rating by their classroom v 
XCM hers. 



Methods 



Sttbjr<t\ * . 

Subjects lor the study were HO develop- 
nrentallv disabled adolescents (17 male and 
13 female) admitted for evaluation and 
short-term tieannejH mi one jnpatieni waid 
of the Mental Ket.udation and Child Psy- 
chiatry' Pro-am. CCLA Ncuropsschiatru 
Institute (NIM). Mean age ol the subjects was 
M.:> yeais tiange 12.2 to IiO.8 \ears). All sub- 
\ri Is basing complete tesi records were se- 
lected liom a total population ol -18 patients 
admitted to the .ward over a 2-\eai period 
from lt>?7 to 1*179. All suhjctts had devel- 
opment. d disabilities (primal ilv mild ictar- 
elation and/oi serious emotion. il disoidcrs), 
and theii IQ range was appioximaicly f»0 to 
80. , 

Setting ami Tcifing l 9 nnvthitv\ 

All subjects were enrolled in NTl School 
•classrooms foi 2 to 3 hours eat'li dgy, and 
one of tbeii 2-houi pei iods .eat hAv^wk was 
spent in the pievoi atioual shop pn¥^f;uii of 
the NTl School. All subjects wire enrolled 
in the shop program lor a minimum of I 
month with a lange.from I to 5 mouths. A 
more complete desciiption of the total 
school pi ok rum is provided in l ; oi;ness 
(1 977). The administration ol each subject's 
AAI was routinely done in an individual ses- 
sion by the shop teacher during the hist 2 
weeks of eacdi subject's admission, (ialilornia 
Ac hieveineiil lests ((iAT). at (he Upper hi- 
maiy ot KhMnentary levels. weiV adminis- 
tered in indi\idual sessions by the student's 
classiooni teacher during the same 2-week 
period. A behasior rating wms also done by 
two classroom teachers who rated the same 
itudent independently within the first 2 
weeks of admission to the classroom. 

Gr«ide*level equivalents lor cmcIi CA T sub- 
test were used in the data analysis. Kach stu- 
dents classroom teachers (in his or her ac- 
ademic classroom, not the shop program) 
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were asked to rjiic the itfudent on a scale 
rouiineh used bv ih/NPI School stall to 
measure the .Undent'.* iKrhaxior and peer re* 
lationships. hn|he academic classroom. There 
wx\r - ciiOu itetM*- Militated on a ^point 
Leikett stale. The eight items were task nt- 
tfntnjpf. Independent ivoikhig. ability to 
contmftiikaio needs effectively in -the class- 
room, ease of classroom management, par- 
ticipation in group classroom activities, age- 
appropiiate peer interactions) popularity 
witli (lassioo!U4>eers. and ability to develop 
reciprocal friendships. As indicated alw>ve. 
J wo teat hers (or oW teacheivand an assistant 
teachei) lated'the sWident ihcleptMidetn.lv on 
these" Males, and reStuH-tiom both tcac hers 
weie averaged lor each sc ide^JJttSsihle semes 
tanked hoin K (indie at ip^pooi adjustment) 
lo fifi (indicating goo*iadjustnicni). ' 

Awrwnient of Applied Skdh > 

"I he tec lini<|iies ufcecl on the AAI to meastne 
applied ac ademic and social skills weir b.tsed 
on a immUr ol veais i ihsei vation ami c\- 
pciicinc in the NIM pic\oc atimial shop 
cl.tssiuiiin. I hcv weic also based on i'nfoi- 
m.ttKM) about (be demand rhaiac teristii s ol 
vocational and picxnc ational settings Iioiii 
which adolescent p.itients'h.td l>ceii lelened 
and in \\hi( h ihev were snhsc(|ueiill\ plated 
altei disihaige Irom the XVI ptograin. Sev- 
rial \eisimis ol the Applied Assessment In- 
Miuinenl were piloted beloie the present 
vcision was developed over 2 vears ago. 

I he Inst set (ion ol the AAI is designed to 
assess thiee skills i elated 10 reading: 'applied 
trading. tompieliefiwihi, ainh///J/y/i'»M fn/lowmg. 
■"Reading" skills aie measured hv having the 
student read aloud thiee shoit paragiaphs 
ol dhci lions Irom actual projects ;it thiee 
leve ls ol djlhc ulj\; primary giades (from a 
piojec i on building a wooden iov line. k). up- 
per cleutentarv tdoitig simple needlepoint), 
and junior high (constructing a plywood 
hooktai k). "( 'omptehetisioir* is measured hv 
having the student rc|>eat these directions in 
his 01 her own 'Avoids, and "direction h •Mow- 
ing" is ineasnled In haying the sindent a<- 
inalK ianv out these directions using die 
actual materials deserilied. ()|tt'iaiional del- 
tuitions ol s|M k < data-based jieiloi inane e 
weic convened to ti-point l.cikcrl-t\pc 



scales, lor cadi ahilitv on each level of par- 
agraph difficulty, possible scores fop the 
three rending^related abilities (applied read- 
ing, comprehension, and direction follow- 
ing) thus ranged Irom 3 to 1H points each. 

The Second section is deugned to assess 
applied number \kill\ related to counting, 
numbering, measurement, and telling rime. 
Applied number skills are measured by 
counting pieces or materials depicted on 3 
sheet of directions, pointing to numbered 
ilemwlepiclcd on dtawings. telling time, 
measming items with a ruler. and identify- 
ing simple fractions and decimals relating to 
measurement. Assessments are obtained in 
ten areas, each 'measured oira f>-j>oinl lei- 
kctt scale, such thai a possible, seme langes 
from 10 to 50 points lor .this section, The 
1 1 111 c I section, wcial \kdly contains six Areas 
w|iic b aie assessed hv observing the student's 
1 01 it ent 1 at ion, h ust ration point, ahilitv to 
a« iept guidance*, ahilitv to woi k iude|>en- 
dentlx. caie and resjx'c 1 for tools, and co- 
operation while being tested, f at h area is 
assessed on a f>-point sciile with a possible 
score i.mgim* houi t> to M) points. 

I be louiih section is devoted th applied Y 
mulm \kdh which aie nieasuied bv observing 
1 he student's abilitx to usecomuioii tools and 
rating his 01 hei pei foi mam e on structured 
t.isks. Skills ohsei \ed aie the student's use of 
a screw diixet to attac h elillercnl si/ed 
views to wood, threading nuts and hulls 
with a wieiich. Hitting a board in diflering 
angles with a handsaw, and driving various 
nails it t c c > wood with^t hammer.' Skill is a|so 
observed in ihieadiug different si/rs of 
needles, drawing a simple gnd. and the use 
ol srissois totut simple pat ions out of lx>th 
cloth and. pajKT, This 11101 mi skills section, 
ln>w'e\< i.. was not iii< hided in tin 1 present 
anal\sjs which lo< uses pi imarily on aca- 
cleiutc and social skills. It should Ik* noted 
lli.il total assessment time* on the AAI for 
(Mch individual was approximated -lf> min- 
Mttes. 

Results 

'I able I piesenisihe mean, range, and stan- 
dard deviations of the CAT stores, class- 
loom UMchei latiugs. and applie(l aiademic 
and social scoics foi tin* entile. sample. Note 
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- \ - * TABLE 1 

Means, Ranges, and Standard Deviations for CAT Subtests, Teacher Ratings, and Applied Academic 

and Social Assessments 



XUasvrumn \tra\utr\ 



V 



CAT reading \o< ahul.n v 
("AT reading comprehension 
CA l arithmetic reasoning 
CAT arithmetic lundanirinals 
Clj»room teacher's bclta\ior 
rating 

MM applied aracU'iiiK and 
social assessment 
Reading 
Compiehcusinu 
|)irceiintijfo||i»\iug 
Number skills 
Sim ial skills 



4.f>0 

4 .55 

4.52 

4,*7 

Hi. I 



149, 
II. H 

HUi 

$9.b. 
22.9 



Ron 

(1.7 in 9-0) 
<I.H lo 7.9) 
(1.2 to 7.9) 
< .9 Hi H-7) 
( |().n in 24.3) 



O id IK) 
(.'I to IK) 
III in IH) 
(24 to 4?)) 
(9 in HO) 



S7) . 

I HN 
III 

I.SH 

MM 
4 11 



:\ as 

4. Ml 
III 

Ii.fi9 



iERIC 



dial the mean achicxcuiciu Mines ol the sub- 
jects arc at tlic loiulh made level and that . 
their appeals to lie considerable variability 
in both jihe classroom tcai her laliiigs and the 
applied ;ieadciui< and social scores. 

S|*earmati rank-oidcr coriclatious (>//c/s) i 
\\0!C computed U'lua-n CA T subtest scoies 
and corresponding academic areas on I he 
applied*" assessment instrument, and these 
sue presented in Table 2 ;ilmiR with coric- 
latioiis Ix'Uvceii ratings oMassroom teai heis 
and applied soc ial skills. Note that gencralh 
AAl reading seoies do "not cm relate as 
highh with CAT reading \ocabulaiy as they 
(In with CAT reading conipiehensiou nor do, 
AAl inimber skills correlate as highly with 



CA T iuilluuelic* lundamejiials as ihey do 
rcWoiiing. °* 



with atithmciu 



Discussion 



The moderate but jjenei allysi^niluatii t«u- 
relatious lotmd bciwccn < lasMooni measures 
and assessment ol similar academic and so- 
i ial skills in an applied situation appear to 
Miggc-st at least some snppoit lor the con- 
i uric tu \alidiiv ol the AAl as. described 
herein. ( '.oi relations of a mm h highci order 
might, in but, have been iutciptelcd as not 
suppoiting the use ol the instrument since 
;1 uioie complete nveilap ol ihe two types ol 
ineasiuemenl would surest that the more 



TABLE 2 - ( -. 

Correlation Coefficients (rAo's) Between Corresponding Classroom and Applied Assessment 

AMrfitd Anulnn'u ttnd Sotmi .twrwinrnt 



('.Itntnunn Mrasutfs 



Hauling 



CAT reading vncabulars 
CAl reading comprehension 
CA l" arithmetic litiidantciitab 
CA I' aiitlnneiic Masoning 
Cl.tv\UM>m Ix'hasior rating 

: ~ : 

Sign ill Unt at the .OS lexel 
ant at the .01 lesel 



Comfnrhrihion 

M>-i . y» 

.4W" 



Dirri'Uon 
.499** 



.514** 



Measures 



.Sin mi 



ft 
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traditional use of achievement scores and 
teacher ratings are sufficient to predict pie- 
vocational or vocational success. It is of in- 
iciest in this regard that the basic skills ol 
reading vocabulary and arithmetic Itinda- 
mentals did not scetp iq ? elate a* highly to 
AAl skills as did reading c otiiprclicnsion 
and ftiiihtuetic reasoning, cvhichiend lo 
iiR-Hsuic the applnnlwn o I basic academic 
skills. \ 
* In the same vein, ditcftinu following, as 
measured on the AAli did not tend to cor- 
relate as highly uiih anv CA T reading sub- 
test as did the AAl mcasuics of trading and 
cmnpudicnsjun. These findings may sug- 
gests ill least in this instance, a possible con- 
tinuum lauging from aupnsilton ol basic ac- 
ademic skills (e.g.. i ruling recognition) 
through their application in an .acailenm^ 
ctmtexl le.g.. reading comprehension) to , 
tlieir nltimatc application in a piaciical con- 
text (e.g., -following writ ten diicc linns in a' 
picvoi :itiou:d situation): h 9 

The lad that at least moderate relation- 
ships weie lound tiding ;t rrlaiivclv hclero-; _ 
geueous adolescent population with rda-,, 
livc-lv variable, behaxioi seems alst;> to lie 
significant. I he assessment of academic and 
mm ial skills under woi k ichitcd 'conditions 
would seem panic ulatlx essential to place- 
ment decisions involxing dcvclopinciilallv 
disabled pcisom wit h v obvious piobleuis i\\ 
depcutincni. The AAl. or insirumeiits sim- 
ilar toil, might l>e useful with jusi these types 
of individuals since their ability both to 
piolit hoio academic mstruc tiy.n^S well as- 
to apph what skills thev doleain mav Ik* 
iniMe limited than developtncntally disabled 
j^lrnts with" lew* l>ehavior pioWcnis tS;v- 
maiiski & Tanguay. h>HO). 

It should lie stressed, however, that find- 
ings illuslialiug the validity of the AAl or 
e\en the instrument itself ate not as iiupoi- 
tant as the concept of assessing a hattdi- 
cap|K'd student's abilities to apply academic 
and social skills. Any assessment ol ibis type 
is essential for two pin |w>sev first, it enables 
a shop or vocational institiciot to ascertain 
whether a Modem has mastered the aca- p 
detuic or soci;jl com|>etcncics essentia! to 
either pie vocational classroom situations* or; 
on-the-job training. Secondly, it provides* 
feedback to classioonv teachers $m whether 



theji insmution Is actually rrhvant to the 
students cut<reul ca1cer f or vocational needs. 
In both instance*, there an* cleat; implica- 
tions for. the instruction of developmentally 
disabled or other -types of handicnp|>ed stu- 
dents/ either, in. regular 01 sjuTial class set- 
tings, t'anicnlaily as such students rear' 1 
junior high sc'hooj ages, or even prior to that 
point, teachers nc;ed to l>e concerned more 
directly witlv the gcncrali7anon and appli- 
cation of skills learned in their c lassrooms.' 
Instruction 01 remediation in such skills may 
be nunc effective il l>egan couctn renily with, 
or even piior to, the student's pre vocational 
01 vocational .(.ruining. Assessment of prev- 
ocatioual academic skills tbtis becomes critt- 
"cal In the fask of providing the student's 
teachei \yil^jMeedlfctck as a basis lor devel- 
oping more'rcleVant individual instructional 
programs in the classroom. 
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DIAGNOSING INSTRUCTION 



Traditional diagnostic approaches usually ocoir 
outside iheMnstuiciiooal umitxi und locm mi 
the leaincr. Accurate conclusions *hou( the 
learner, however, can <>nly lx' readied alter an 
adequate diagnosis o! imtiurition. Failute to 
consider instruction as a variable results in 
diagnoses that laik spctifii implications lor 
training. Assumptions und procedures critical 
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to an afleiptaie diagnosis ol instruction aie dis- 
cussed and applied to a vaiiriy ol examples. 
"Hie pi iK ess ol derivation nl icuiedies and its 
lclatioinJnp U> the <lia^no\lii pun ess in illuv 
Hater! with examples. - linplu annus loi the 
diagnostician and the eonseipieiu es of failing to 
pi ovule adecpiate instuu lion.d diagnoses arc 
discussed. 



• VARIABLES OF DIAGNOSIS 

Traditional procedures used to diagnose the learner are extremely weak be- 
cause they do not assess the instruction the learner receives; they only assess the 
learner. Typically, a diagnosis is called for when there is trouble, generally be- 
cause whatever the teacher is doing is not working. The learner is'noi "grow- 
ing." "developing." "interacting," or "behaving" in an appropriate manner. A 
diagnosis is achieved by removing such learners ftom the instructional setting 
and giving them a scries of tests that provide a sample of the leai net's behavior. 
The assumption is that the sample provided by tests is somehow better than 
other samples. While the interpretation of the sample ostensibly tells something 
about the learner, the diagnostician neve; draw's conclusions about persons or 
factors other than the child, e.g.. " The child's performance on the Bendci Ges- 
talt clearly indicates that the teacher is very poor at classroom management." 
On the contrary, interpretation always tells about the learners — their predis- 
position, mental abilities, skills, personality, intelligence, sensorimotor perfor- 
mance, and so on. 

There is no severe problem with the diagnosis until a remedy is drawn from 
it. Tor while the sample of behavior may be useful for classifying the learner, it 
fails to suggest adequate remedial action. Every special educator who has 
played the remedy game recognizes the problems encountered at this juncture. 
"It seems." the psychologist says thoughtfully to the teacher, "that you should 
work on auditory sequencing." . , . 

"Like what?" ' / 

"Well, counting." 

"We do it." > 
00*22-4669/79/1 S04-0003$0l .00/0 
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"Well, what about completing words in a sentence?" 
"Like what kind of sentence?" 
44 *\Ve find cows iu the 

"He canYdo \\r a 

"That's probably what you have lo work on. M v 
"How?' 1 

At this point, diagnosticians 'are so far beyond the information provided by 
the test, and so far from the lealities ol the teaching situation, that if they're 
smart they'll rQlreal from the concrete details that teachers need lo the more 
comfortable generalities that characterize staffing*. Actually, the diagnostic 
procedure is p perfect charade if the goal, of diagnosis is lo lead to a rtrmedy. 
For a lemedy lo follow fi^m the diagnosis, the remedy must provide teachers 
with inloima(i?H) that they don't have. It must tell them what, if anything, they 
can do to improve learner performance, lt^hould not tell them what they al- 
ready know, (hat the leai ner has spine son of deficiency. Teachers know pre- 
cisely how the delkiency manifests itself, wharthe learner has trouble learning, 
<md Jirtw t lie leainer responds to different situations. Teachers, however, are 
not usually instilled by a diagnosis that may tell them far loss thpn I hey already 
know if that diagnosis assures them that (a) the instructions tfr^v have provided 
are attenuate and (b) the lenr ncTs failure is the result of some bqsic flaw in the 
learner./rradilional diagnoses are designed lo provide these assurances. Unfor- 
tunately, they (airy very limited remedial implications because they do not 
specify (a) the extent to which the learners failure is caused by poor instruction 
and (b) precisely what the teachers could do to remedy an observed problem. 

The traditional diagnosis is incapable of expressing remedies iu the basic- 
units the teacher manipulates when leaching. The teac her ac hieves teat hing (or / 
changing behavior) not by manipulating neurons, the leai ner s past history, or' 
internal pi <x esses of any sort. Ralher,(lhe teacher achieves behavioral change 
only by manipulating environmental events. This point is extremely important. 
It follows that ihe remedy must deal ly tiirtply manipulation of those envi- 
ronmental events. It must tell teachers what they are doing wrong and what 
types of different teaching behaviors the} should implement. The .remedy must 
be specific and tone iclc because teaching always involves specific. concrete acts. 
I he institution "Teach serialion" does not tell the teacher what to do. when lo 
do it, how to respond lo specific errors, how lo sequence examples, how to 
review, or how to reinforce. Yet, in order to "leach seriation," the teacher has 
to present examples in sequence, say specific words, and respond in some way 
•o the learner's attempts. 

Traditional diagnosis {assumes thai all relevant information comes from a 
study of the learner. An equally tenable position is that all relevant information 
comes from a study of the instruction the learner receives, not from the 
learner. Neither position is reasonable. The "learner's behavior is influenced by 
two major fac tors: (a) the innate capacity or predisposition of the learner and 
(b) tile instruction the learner receives. In oilier words: 

S B (Behavior) - V (Predisposition) + J (Instruction). 

BEST COPV AWiMSLE , 
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In this formula, Prvdwposil'wn would include all factors iliac leinaiu unaf- 
fected l>y instruction. (II die ' learner exhibits die samc^ pi oblein legaidlcss of 
instructional approac h, die problem is c ojur.ulled by ^yedisposition.) hi\(nu (wti 
refers to the ^fleets of teaching — intentional 01 n^mfnliicMial. ( 1 1 die- pi oblein 
can be eliminated thiough instruction, the problem is controlled by instruc- 
tion.) 

When wc observe a given behavior, wc ca*mot specify the extent to which il is 
"controlled by predisposition or by insiructionT^Ve may assert (hat it is con- 
trolled primarily by one factor or^anothcr, but on i assertion is based on igno- 
rance, not on fact. We might conclude that the learner lias a perceptual pi ob- 
lein when in fact the obscuved behavior has heed caused \4f poor jnsluic tion 
and can be eliminated through in.shuctiun. 

One way to extricate ourselves from this diagnostic dilemma would be to i ule 
out one of the two variables (V or I). II we could eliminate the learners predis- 
position from the observed behavior, we could use the I'm inula; \ = H - I*. II 
we could rule out the instructional influent c "and look only at the learneTs 
predisposition, we could- use the formula: V ~ B — I. Unfoi rimateh . we cannot 
remove the learners from the effects of the instruction they receive 01 liotu 
their innate predispositions. We must therefore try to control the variables I* 
^ and 1 in some other way, and the. control must Ix* designed so thai it doesn't 
require removing a variable (or pretending that we remove it). 

There is no obvious way to control P bv impioving it, maximizing it, or rede- 
signing it so thai we know precisely how it win ks. We can, howevei, control I. 
To do this, we- maximize I, which means that we design it so that il woi ks ac loss 
a wide range ol learners, When we design J so that it is basically faultless and 
'incapable of contributing to the learners behaxioi problem, wc can-draw 
conclusions about both l x and I. If B changes greatly with I controlled, we 
conclude that I is the primary factor in determining H. II B does not change 
greatly, we conclude that V is primarily responsible for the status of II. 

We have now gone full circle and have come to the central diagnostic prob- 
lem. We wish to control I, First, we must determine what type of control is 
needed and to what extent 1 is in need of maximization. In oilier words, we 
must diagnose instruction. The diagnosis perforce must be ol instiut tion, not 
ol the; learner. The instructionahcliagnosis involves two steps: (a) interpreting 
instruction the learner receives according to the minimum-knowledge assump- 
tion, and (b) testing the minimum-knowledge assumption by pioxicling a 
maximum-knowledge test. 

The minimum-knowledge assumption 

When we view instruction, we see the learnet responding to dif ferent things 
the teacher does. The teacher presents tasks, and the learner responds. I he 
minimum-knowledge assumption holds that the learner uses the least possible 
knowledge required to produce the various behaviors we observe. For example, 
the teacher says, ''Open the door, Henry/ 1 and points to the door. If Henry 
opens the door, we cannot assume that Henry understands the command, 
"Open the door/' becati.se Henry was not required to respond only to the 
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w'oi^f.s. lie could have responded only to the teacher's pointing. The 
minimum-knowledge assumption holds that Henry did just I li.il — responded 
to the point, not to the words. 

The maximum-knowledge test 

'The minimum-knowledge assumption is perfectly consistent with the oh* 
served behavior, Funher. it tarries implie;itions lor iusti u< tional rontiol. J hat 
is. we ( an (lesion a* test that eliminates the t cachet's point and presents only 
words. I his lest icc|uhc$ knowledge of the words — the maximum-knowledge 
test. The minimum knowledge assumption identifies the simplest mechanism 
that accounts I'm what the lrarnVi does. The test ol maximum-knowledge re- 
stiu< tines the'siuratiun so that the leai ncr cannot use flic simplest mechanism; 
„ Kafluie to inakc-the rninimum-kiVowlcdge assumption ic.su Its in failure to test 
the possibility that the learner is responding to messages orfier than th^ ones 
the teacher intends. Let's say the teacher handV^a leainer a piece of candy and 
says. 'Kiit 1 1 1 i v. '! he traditional intei pi elation assumes that if the learner ate 
t^c candy, the leainer understood the directions (maximum-knowledge). I he 
minimum-know ledge assumption holds that the leanicr is icsponding to the 
candy in the hand, not to the woids; in other words, the learnet. would eat it no 
mTVHOI what the teacher said. Then the nrinimu^^^^ can 
he tested (pel haps by handing the learner candy and telling him/her. "Don't eat 
it." or "Shut the dooi"). The minimum-knowledge assumption implies the 
maximum-knowledge test. II the minimum-knowledge assumption is not made, 
however, the lole ol the instruction in the learner's performance is not tested. 
Two" points ahottt the diagnosis ol instruction shoiild^hc noted: 

1. The minimum-knowledge assumption is jusl that — an assumption, not a 
fact. The assumption should he tested, and the test will cloaily (fetcrmitjjc the 
extent to which it is confirmed. 

2. The minimum-knowledge assumption can he made about written de- 
sciiptions. hut the use of these descriptions in formulating diagnoses is not 
clficicnt hecause they rinjmt piovide sufficient detail about what happens dur- 
ing instruction. Written desciiptions onlv tell ahout thostf details of whit h the 
writei is aware II the write! is miawaic of suc h details as sequencing items, the 
w linen insii union obviously will not mention these. Also, wtitten descriptions 
aie olten useless hecause teachers do not lollow them. 

APPLICATIONS 

Below are three applications of the diagnostic procedure, relatively elemen- 
tary examples. The same basic pioccdure can he used in mote complex situa- 
tions, however. The first two examples involve situations in which a problem 
has been identified. Situation I involves ;i learner whose behavior is not chang- 
ing in the expejted way. Situation 2 concerns a learner who seems to have 
trouble billowing instructions. Situation !l. however, involves a leainer who is 
pel forming acceptably but who exhibits a pioblem when the procedure used in 
the 1 picvious examples i^applied. The minimum-knowledge assumption iden- 
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tifics |MissH>fO misimcMpu'tations ihat are conveyed through instrui tion, 1 1 u- 
maxumun- knowledge test Vonfu i^Uiauhv deficiency in insinu titiiKil proce- 
duies has icsuhcd in ;j deficiency hi the learner's u i)dc» siuMilii ig, The poini is 
ih.it the. diagnostic pioceduies can be ap|>fjcd before a problem is identified 
and tli;if preventive measures tan be designed to obviate die instnu tional de- 
ficiency. 

SiM&Hon 1 ' 4 

The teacher is trying to teach or reinfoice numbnnskills of low-language 
children by playing a game with oversized dominoes. Aljer placing a domino in , 
the middle of the table, the teacher Nays the nnml>er shown by lijN/herdominu. 
If a child has a -domino with \\ jnatching nnnil>er oi dots, the child is to place 
diat domino in the middle of the table* 

The problem child in the group* throws out itdomino ever\ time the teacher 
places one on the table. The teacher s 1 espouse is siii)ply !o ignoie the iuappio- 
prtate responses by pushing the domino back to the child and continuing the 
task. When the child's response is appropiiatc, the teacher remjoites it. The, 
teacher's attempts to "shape" the child's behavior have not worked. 

Mini mum* knowledge ^sumption. To (cumulate the assumption we ask, 
"What is the least amount ol knowledge le.u nets c ould possess and perform in 
the ohseivcd way?" They would' hut have to count thettotvon rhe dominoes 
and would not have to undeisjland that they ate supposed to tlnow out .1 
domino only if it matches. They could pei'lorm in ihe obsei\ed maimer il the) 
operated from the principle: "Throw out voun domino each lime the teachei 
presents one. rrom time to time, you'll be reinforced/* 

We assume, therefore, that the learner operates from this behavioral rule* 
and that the learner has no knowledge of nimibeis. matching, or the udes of 
the game* 

Maximum-knowletlge test. A number of maximum-knowledge tests are pos- 
sible here. The requirement for each is 1h.1t it must lot the child's knowledge 
of whether the number of dots match, For instance, we could prmide the 
learnei with a row of dominoes and hand him/her one domino, whic h the child 
must place next to the domino with the same nnrnbei ol dots*. 

Situation 2 " 

Jenny pel forms successfully when the ^following tasks aie piescntecl in lan- 
doln order, Touch \our bead . . . touch youi nose . . . stand up . . . pick. up the 
fork . . > pick up the pencil. 11 

Jenny has difficulty with tasks such as, 'Tut the pencil undci the chair/' and 
'Touch the pencil." (She puts the object handed to hei on the chair, aiul she 
picks tip the pencil) 

Minimum-kntMlvdgv asst/m/X/on. Jenny pcforms by cueing on the |;^t word 
in the command. She cannot perform on preposition tasks because words other 
than the last woid pi ovide instruction about what to do. She cannot pel form 
on "Touch the folk 41 because she ignores the word touch. p 

Maximum-knowledge test The maximum-knowledge test must fust deter- 
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mine whether jenny could follow two different 'commands involving the same 
object. Could Jcnnv. for instance, "touch the fork" as well as "pi<k up the 
lork?" The test would involve random trials of ihesc commands. If the 
mmimiim-knowlctlgc assumption is correct ^^nhy- wouldj pick up the fork on 
eveiA tind. even after ihe correct i espouse lotouch fiad been modeled and em- 
phasized in ihe commands. * 

Situation 3 

Ann. a junioi-high student, performs well on a variety of antiemetic tasks. 
She woiks simple algebra problems; however, the piogram thai she uses re- 
quires application of laws, such a* associative and distributive', and always re- 
quites. problems in be solved for A* Or A (not for 2X* or liz/t). 

Minimum-knqwhdfie assumption. Ann. lias learned strategies for solving 
pioblcms thai would tioi permil her to solve a problem such as: 4A" = 7; $X = 
— . This minimum-knowledge assumption is based solelv .on the program, not 
on an observed behavioral deficiency. The assumption is that. if Ann is "nor- 
mal." ii is quite probable thai she developed a strategy that would not woik well 
in solving lor values othei (ban A*. 

KU\inwm-knowlcdfie tvsl T he most direct test would be, to require Ann to 
sobe'ihe same problem foi -diflei\nt values: 

iX = 7 4A - 7 4X = 7 4A r - 7 

!*A' VaX = _ 7A - _ V*X « _ . 

Rcmodiv* 

Remedies follow logically from learners' performance on ihe maximum- 
knowledge tost, (f learners fail the test, they must work on tasks or activities 
that can account for passing the test. 

II >h<; domino player did not pass. the lest that required matching a domino 
with ihe appropriate one in the teachers display, the task would be simplified 
(rcdming the number of dominoes displayed by the teacher), and the preskill 
of counting ihe dots would be taught and then applied to the matching proce- 
dure. Initially, ihe sum turc of the task would involve steps such as: .'"Count the 
dots on your domino . ... How many dots on your domino? . . . Show me the 
oilier domino that has four dots . . . Tin your domino next to the domino that 
has lour dots . . . Good job," Later, the steps would be "faded" and the learner 
'would be rcqfiired to perform without prompting. Once he/she had demon- 
strated proficiency requited to pass the maximum-knowledge test (in whicl^ 
he/she would be fciven different dominoes to be placed next to those that 
match), the original domino game could be reintroduced, perhaps with new 
Miles: "If yon put out a dOmtno that does not match, I get one of your points/' 

Again, if Jenny failed the maximum-knowledge test, the implied remedy is to 
teath the skills required to pass the t/\st. To achieve this, we might fust teach 
her single word commands, such as 'touch " We would initially present un- 
familiar objects or those thai arc not easily picked up. T he teacher would say 
the word "touch "^.and then denmnsfrate or model the response. Jenny would 
next 1>e tested. After pcrfonniojg acceptably on these objects, objects such as 
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forks 5 MM! <; *ndv would Ik? introduced. Next, she would bo laii^lu to discrimi- 
nate between theconmiand "touch" ami the command "pit k up." Iluth com- 
mands would bo given lor the same object. lM>Husiancc, a loik would be pre- 
sented, and Jenny would be given these eominands: ' Touch . . . lorn h . . . pick* 
up , . . toucir. * . pick up , , t pick up . . . pirk up . . . . touch" V 1 ^ Afu-i Jc-ntiy ■ 
" performed acceptably <Ai this type of task, tasks that name both the object and 
the action would be introduced: "Touch the ball . . . Pick up the bowk . 
Touch the fork . . . Touch the candy."* Wlien Jen^iy tan pet hum these tasks, 
she* has passed the maximum-knowledge test. To respond coi rectly. she must 
attend to and understand the meaning of the commands, whuh'means that she 
must have maximuu) knowledge. 

The remedy for the pool arithmetic Sequence would be to tea* h Alio a strat- 
egy that would ^permit her t<> solvv problems thai requite solutions lor values 
oilier than A. A possible strategy is to show Ann that a problem ol this type: 

IX * 7 * 

is simply a ratio pioblem with -equivalent fractious on either side of the equal 
sign: 

4 _ 7 

; 3 T ;" " • \. ";■ 

The game involved in solving the problem is to find the number thai \ must be 
multiplied by to change it into 7. We must multiply 3 by the same value to get 
the answer. 

Once Ann has applied this analysis to various problems (both i alios and those 
involving letters), she should have no trouble with the ma xinmm- knowledge 
test. 

ASSUMPTIONS, TESTS, AND REMEDIES 
• 

The procedures outlined show the relationship between the minimum-, 
knowledge assumption, the maximum- knowledge test, and the u*med\, The 
examples of remedies are based on situation* in which the learner fails the : 
maximum-knowledge test. II the leather passes the test, ol course, no remedy is 
implied; we simplv conclude that out assumption of minimum-knowledge fcas 
not confirmed by the test. Possibly, the test will provide only a partial tonlii illa- 
tion ol the assumption, winch means that the learner will fail only pait of it or 
only some types ol items, JVrtormance will imply wh.u we must teach before 
Mhe learner performs adequately on the missed part 01 items. 

DIAGNOSIS AND rImeBy 

The purpose of instructional diagnosis Is to detet mine aspects ol instruction 
that are inadequate, to hnd out precisely how they are inadequate* and uniiydy 
what must be v done to correct their inadequacy, The assumption Ol minimum- 
'knowledge is centtal to the diagnosis. If it is not made, the instruction is auto- 
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-jiiaijyUly ^xonoraied. and the fault for poor pci formance is automatically 
placccfon ihe learner. II we fail to rcc ogni/c t liat instinct ion permits and rein- 
forces domino players (01 throwing oui (heir domino on cvciv trial, we may 
conclude thai ihyy are slow learners* that they xlo not respond to the "punish- 
ment" of teachers ign*>iing iheir inappropriate responses. 1 he leather's pnice- 
clutes, although faulty, become cxonoraicd. alid the diagnosis shifts to 
cjueshons o| why the lea? net lends to respond in such a strange way. 

By tailing to make the minimum-knowledge assumption about Jenny's u^r^ 
foimancc, wctare left with the uncomfortable coin lusion thai she is apparently 
capable of responding to commands; however. I his is not'TfrU vavs sc LJLUdt?ss we 
note tlui her pet formance is perfectly consistent with whaj she has beet) rein- 
forced lot doing desponding to commands in which th^ last word convoys tall 
the impori.tni inhumation), we must uy In account for her eiratic behavior. 
Oui ;itientioii inoves'lrom the instruction to Jenny's personality, learning style, 
developmental p. itUTn. or whatever. v ." 

Simil.nly. failure to apply the minimum-knowledge assumption to Ann pre- 
vents us horn lurthci tests ol ihe programs adequacy. Instead, when she de- 
velops serious problems in arithmetic, we conclude that her problems are 
caused by an internal mechanism, not by ibe piogram: "Ann lacks aptitucfc'." 

In e\ei\,<;js^\ oui c on< (usjojis ;ne prcmaiurc and unfounded.. They rcprcv 
scnl ;t f)f).wtbf( M inierpi eiaiion; the other, and ecpiallv possible, interpretation is 
that the leaiuct icspnrtds in a way consistent with the instruction presented. 

"When itisirm lional deficiencies are not identified, the lonelier may under- 
stanclahh become* irustraled. Kven (hough ihe teacher works harder on follow- 
ing diiei lions, jemn persists in making the same mistakes. Haying the domino 
g.une mote Irecpicmlv does noi serin 10 improve the learner's performance. 
Reviewing simpler piohlcms -does not seem to help Ann work-rite -more dillicull 
ones. 

In shoit, ibe teacher draws dangerous conclusions about the learners; in- 
striuti v on appaicntly does not seem io change their i espouses; therefore, the 
pioblem nnisl be with their predispositions. 

DIAGNOSING THE LEARNER 

-The only valid way to draw conclusions aboni deficiencies involves first de- 
termining the degree 4 to which the learners performance is controlled by in- 
struction. \Ve must go through the following steps: 

1. Diagnose the institution the leanier receives (observing instruction using 
the uiinituuni-knowiedge assumption ancl then providing the maximum- 
know ledgr test). ■ ■■ ■ f .■ 

2. INovulcvjiisiructlotiarmiiedies thai account foi the skills tecjuired by the 
maximum knowledge Lest. 

X ( )bsei ye diserepanc ies between the learner's performance and that of a 
noi mal learner. 

The first two sieps factor urn instruction and identify the extent lo which it is 
responsible for the observcrcll>ehavi<>r» We can then indicate the extent to which 
performance is caused by the .lea liter's- basic makeup — the third step. If the 
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ficteucy h iaus.e*i. i>?.i|i» i.< ». ily I* >' pV vsi * sji*>?.i t i oi i . I f riie lea? wvli^ . 

cx;|inj>lc, wheiv'ii K 

been rcinfo*rced (or years, we would expect lem uing to proceed Mow ly. even if < 
ibc learner is normal-. Relearning it^juires^^Hn more pra<ti»e tbati initial 
learning. Moveoycr. learning unfamiliar discriminations •jx-quirevcun,side»;ibf\ 
more practice tban does leai'lji»# 'faniHUt diMrn^infitlihin.s (Kngcbnann & C.ran- 
zin, in press). In tbe <ase of a ^nt;«liEfr -^||fKllW>.*lfM?Vf!:«* ^Ht^tWleO .|«> verbal utter*; 
sinces; twe catvasMunc ihst nvhi^l Jearui|>^ (e>'en;lov.:a mjrnjal le-u nei;) woukl be 
«|iuic slow (requiring bmidiyds ' '^f "M>" IMMs^? K^l»w'^ 'Vjt •M'.^ , * , ^ , VV , ?lf!l*K* 1,1 *l l : 
\Vben our goal is to WHIN illUy, \ye, : «Mi «.w am deficiency as die basis hn 
: concluding i bat the learner is below, normal, 1 1 we wish to find out the extent to 
which this iu'li^vM^Hnpltes tt peisis^eur *urd h « eve» sible vdelici<'>Hy, we tnust - 
first teafh the learner and observe response. <\ ' * 

IMPLICATIONS FOR THE DIAGNOSTICIAN 

•• Yw)»0<ma)!^ he* with a 

finegrained ^ 

locus solely on I be leai ner in an attempt to tell \%bat t> pe <>f deliciei" v he/she . 
has, to relate it to tbe norm, and to convert t be tea< bet s tasu.tl observations ol 
die problem into more scientific langyfa-ge. 

The diagnostician • [ 

of diagnosis is not primarily lo provide a refined stateuK-nt <d \vltat tlie teacber ; 
'already knows, not is jt to ^auction the idea )luit merely i^cause it^niers p<^ , ' 
sess a deficiency, ib>y ^re qu 

nostician M»M perforjn : Q^' Ji^lC *.<*»Mx r ^^"S^^4>M 5 /-! **B J-^^ J' , ^ il fr ul . "! 
strucdohal U&n<^ 

• . deficiency) ts to nnplv att uistnu^mnjM.VVtwedv. ^ * ^'^T-'-r ' '/' . 

: AcceptiuK t j^i & ^>|ti<^ >>v^ is ji^^t t^iirt, H ^ ^^r^ ^ft^ ^ ? at f : 




change i h^rfe^t^ iuv iii^hi ;jt-0 C 







- • n4 


m 


i -. i' ■ '■■•'■..■:-V'V 












/' 






i 






. ..." ;^ 

■ • ■ ■ - ' .■■'■*■ ' ?K 


ill 



















" Mi 



17i<e NJew IWectioh in Educational 




by Benjamin S. Bloom 

0/tf of America 'steading educational researchers discusses certain 
alterable variables that have brought about major changes 
in our view of learners and their amazing potential for learning. 
He believes the list of alterable variables will be rapidly expanded in 
the Eighties, .bringing profound changes in school and sbciety. * 




major revolution has taken place 
duripg the past decade in educa- 
tional research and our under- 
standing of some .of the factor* that dj- 
lectly influence learning in or out of the 



tors (teachers and students) ip the study of 
teaching and learning as they take placfr 
.under specific environmental conditions. 

Increasingly, educational researchers 
arc performing experimental studies under 



schools. As a resrilt, student learning caiv^ classroom conditioning which selected 



now be improved greatly, and it is possible 
to describe the favorable learning condi- 
tions that can enable virtually all students 
tp learn to a high standard. Researchers 
who were at one time concerned about 
providing equality of educational oppor- 
tunity for students now speak of the learn- 
ing conditions that pan bring about 
equality of educational outcomes for 
students/ And such educational outcomes 
arc at very (ugh levels of attainment, 

The direct application of this new 
understanding to teachers and the schools 
has taken place very quickly in some 
places, but in others it may await the 
presence of several conditions. Applica- 
tion of the new understanding will depend 
upofl the leadership in the schools, the 
need for improvement in learning, and the 
role to be played by schools of education 
and teachers of teachers, In some coun- 
tries the leadership in applying the new re : 
search to the schools has been assumed by 
curriculum centers that wcfcve these new 
ideas into the instructional material and 
into th£ instructional processes for the 
new curriculum. This procedure has been 
especially effective in curriculum centers 
that provide inservice education to teach- 
ers for the new curriculum. 

At least four methodological features 
account for the striking qualities of these 
new research jlevelopments. The simplest 
of these ij^U^movemcnt from a study of 
the characteristics of teachers and stu- 
dents to direct observation of learning 



variables arc studied in terms of the proc- 
esses involved as well a$ the changes they 
produce in both teachers And learners. 
Central tp these studies Is the concern 
about the causal links between the process 
variables and the qualitative and quan- 
titative, changes in the learning of stu> 
dents. These are very different from the 
pre-post demonstration studies of an 
earlier, period, since they c^ter on the 
teaching and learning processes that take 
place between the pre and post measure- 
ments; 

I'^^^Tfiird, these experimental studies Jjrc 
| guided by models and theories that em- 
body ^causal links. Th models find 
theories arc the basis for the hypotheses to 
be tested and the research designs to be us- 
ed. Methods pf strong inference are used 
to relate theory and models to classroom' 
observations and experiments in such a 
way that a series of studies under varying, 
conditions is necessary to test aftd im- 
I provMhe theory and the models. 
^TfJut perhaps the taost important 
[methodological change is the movement 
from what 1 have termed stable or static 
variables to variables that are alterable 
either before the teaching and learning . 
processes or as a part of these? processes. I 
consider this shift in the variables used as 
central to the new view of education. This 
shift enables researched to move frorp an 
emphasis on prediction and classification 
to a concern for causality and the rela- 
'tions between means and end* fit teaching 



teachers and students in the classr oom. 
Perhaps, to pqt it in the most direct terms, 
it is a movement from the study of theac 



taking pl^ce in the interactions between (jqid learning. This new concern has result 
--^ « ...... i jn hew Ways of understanding, explain- 

ing, and altering human learning. The 
search ?|^>r alterable variables,- and the 
^causal processes by which they can be 
altered, is a relatively recenVstep in educa- 
tional research* I aim 'confide^ it will be 
centra! in educational research of the next 
decade. Y ' 
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In the following pages I shall describe' 



contrast them with the nonalterable varir 
ables they replace, and indicate the gains 
in education to be secured from this hew 
approach to .educational research and 

educational practice. 

. ..i 

Available Time vs. Tlme-ort-Task 

We have always recognized time as ja 
central factor in all learning Schools have 
allocated a. certain number of years for 
different subjects such as rc^djng*, litera- 
ture, arithmetic, science, or social fctudiev 
In addition, the schools determine the 
number of school days in each school ye<tr 
and the numbers of hours p^r day or week 
that will be assigned to each part of the 
curriculum^Tinie in the sense of year*, 
days, and hours available for sch<H)Hearn-. 
ing becomes a relatively fixed or stable 
variable. To make significant alteration^ 
in these time allocations requires major 
legal, economic, >nd other policy change* 
at the state or total level Only rarely can i 
group of teachers or local school adminis- 
trators make drastic changes in these timer 
allocations. And, >ince these time illoca- 
tions arc much the same for most stu- 
dents, they account for only small differ- 
ences in the learning pf individual stur 
dents within a . classroom or school. 1 

Quitcfin contrast to the concept of time 
available for learning is the - variable of 
time on insH (i.e., iactivfe learning iimt- 
tjme that students are engaged in learn-! 
ing). If two students are in the same cla$$y 
room and one is actively engaged in learn-; 
ing for 90% of the classroom hour while 
the other is actively engaged for only 30*7* 
of thai 'hour,' there will be quantitative as; 
well as du^liiatiye difference* its - their; 
learning during that hour. '?>:>'. 

One method of appraising tl^$^i|<;v 
task; |$ to determine a$variqro Intervjds 
whether or not '.it ''parti^ula^^li^cjtll. ''t*'/ 
overtly engaged irt the learning ^ paying 
attention,: doing wqrk assigned, tn| 
$ome >yay responding In a relev^ 
the instruction and the InsiructiohUl ni*^ 
terial, A second method is io d<?tprmii|C 
the extent to which the student \t c$ytr(iy 
engaged in the learning, This ts tione by 
^arioiij^ 



Whether wic student is thinking m relevant 
ways •boat what is going on in th? class- 
loom or whether his thoughts arc unrc- 
latcd to the classroom teaching/learning 
processes. Most studies report an index of 
timt-ontask as the proportion of the 
-classroom hour the iodiyij^ 
on task ~ overtly, covertly, or an average 
pt the two. 

) Studies of this variable show that the 
percentage of engaged time (for individual 
students or groups of students) U Jiigh*~ 
|y related to subsequent measures of 
- achievement and to subsequent indices of 
interests or attitudes toward the learning. 
In turn, Jirnc-oiMask is largely determined 
by the quality of instruction and the ex- 
tent to which the students have the cog- 
rijtive prerequisites for each new learning 
task. To put it another way, students can- 
not actively engage in learning if the in- 
struction is poor and/or they arc unable 
to comprehend* what is being taught an(T 
what they are to do. 

For the purposes of this article, what is 
most Important is the strong evidence that 
ihej amount of active engaged time in the 
classroom can be altered during a se- 



later achievement have been fOMtlfJ to fce 
about +.30 to + ,70. Most researchers 
Hifid educators have interpreted these rela- 
tions as indications that intelligence and 
aptitude determine the individual's potcm 
tial for learning. Many educators use these 
„tcst icotes as a basi^fox making long-term 
decisions about selection, grouping, and 
even about the types of school programs 
to which individual students are assigned. 
All too frequently, intelligence and ap- 
titude scores dctcrmineopportunitf^ 
further education, student support and 
encouragement, and even the types of in- 
teraction between teachers and students. 

There is some evidence that intelligence 
(est scores art alterable in the early years 
(ages 3-7), but there is little evidence of 
significant alteration in levels of intelli- 
gence as a result of school experiences in 
the later years. Less is known about the 
alterability of performance on specific ap- 
_Jityd? t$sts. _Or> the basis of present cvi- 
dence^ we may regard both intelligence 
and aptitude as highly stable character- 
Jstics. - ^ ^ 

' Quit* in contrast 10 intelligence artd. 
aptitude indices arc cognitive entry char- 



m.** *..v,^ vnaracter- 
Jstjcs, When means arc found for insuring 
that students reach adequate levels of 
competence on the essential cognitive en- 
try behaviors, most students can be as- 
sured of high levels of school teaming 
with very little variation in their achieve- 
ment. The alterability of cognitive entry 
characteristics has the most profound im- 
plications for instruction, curriculum, and 
our views about the learning potential of 
almost all students in the schools! 




of learning tasks. Consider two octeristics. These arc the specific knowl- 



1 of students who are comparable in 
We or previous achievement at ihe 
fuipng of a new course. One group 
learjjis^hc subject under conventional con- ; 
ditiqns white the second learns under a ! 
very high quality of instruction (mastery s 
learning or some other procedure that : 
maximizes learning). During the first j 
learning task both groups are likely to be ! 
very similar in percentage of timc-on-task. 
On the second learning task, the percen- 
tage of time-on-task will tend to be greater 
for the group with liigh-quality instruc- 
tion and lower for the group with poorer 
instruction. If both groups are followed 
over a series of teaming tasks, the high- 
quality instruction group will be found to 
Increase greatly in percentage of time-on- 
task while the low-quality instruction 
group decreases greatly in percentage of 
tirre-on-task. On the final learning task ^^Coghitive 
the two groups (who were very similar on 
the first learning task) will be very dif- 
ferent. These differences will be reflected 
in achievement differentials, motivation 
for further learning of the subject! and 
self-confidence in learning ability. 

Time-on-task is then one of the vari- 
ables that account for learning differences 
between students, between classes, and 
even between nations. Time-on-task can 
be altered positively (or negatively) by the 
instructional process, and this has direct 
consequences for the learning that will 
take place. 



edge, Abilities, or skills that artf Essential 
prerequisites for the learning of a particu- 
lar school subject or a particular learning 
task. Such prerequisites typically correlate 
+ .70 or higher with measures of achieve- 
ment in a subject. Furthermore, >yhen |qucntly assurped to be the primary moti- 



Summative vs. Formative Testing 

In most classrooms achievement tests 
are used for summalive purposes. The 
summalive test evidence is primarily used 
to classify or judge the student on the ex- 
tent to which he has learned the content 
and objectives, set for the course. The stu- 
dents' scores on each test arc converted in- 
to school marks or other indices that com- 
pare each student with norms or standards 
Set by the teacher or the test makers. 
Typically, once a stiident has taken a test, 
he is marked and rarely is given an oppor- 
tunity for correcting his errors or being 
trctestcd. The basic notion is that the 
students have had cqii&l opportunity to 
learn the subject over a defined period of 
time and are then judged on what they 
rhavc learned. This is repeated again and 
lagain dufing 1 lie School yc^r. 
» Test result* and School marks arc frc- 



vators f6r learning in the school. Marks 
based on tests are also assumed to be 
sound estimates of the quality of learning 
as well as a proper index of the quality of 
the (earners* Such marks are eventually 
the basis for many decisions about learn* 
ers, including school programs and fur- 
ther opportunities for education, 
mcnt, and they have an obvious causal ef- l The use of summalive testing/grading 
feet on later achievement. This is especial- . I procedures results in highly predictable 
ly true when sequential learning tasks ajre j jncasurcs of school achievement, Typical 



they are identified and measured, they re- 
p/ace intelligence and apntUdc tests in the 
prediction of later achievement. That is, ! 
intelligence or aptitude tests add little or 
nothing to cognitive entry measures for j 
the prediction of school learning. All of j 
this is to say that cognitive entry charac- ; 
teristics have & high relation to achieve- j 



involved, where it may be impossible to 
learh task B without prior adequate learn-j 
ing of task A*;_: ^ 

are 



liteUlgenct vs, Cognitive Entry 5 

During much of this century educators 
have used intelligence ,ahd aptitude tests to 
predict ichoot achieyemem. In 



entry characteristics 
highly alterable, because they represent 
particular content, and skills that may be 
learned if they are absent, reviewed if they 
have beA forgotten, and learned to a cri- 
terion level if they have been learned to a 
lesser level. In the ne*t section of this arti- 
cle 1 shall refer tp feedback-corrective 
prcccdurcs as one major method for in- 
suring (hat cognitive entry characteristics 
.arc developed adequately for nearly all 
students* Much of mastery learning re- 
search demonstrates that \ht large gains in 
final achievement for mastery versus con- 
trot groypi are attributable to \\\t fact thaj 
the mastery students were brought to high 
levels of achteyem,en|. pft the prerequisites 
for each new learning task, this was not 
done for the control students. 

Much of the variitipn in school learn- 
ing is directly determined by the variation 



ly, correlations between achievement tests 
in the same subject at two points in time 
arc above + .70 (depending upon the reli- 
ability of the separate tests). If carefully 
"made standardized tests are used over a 
number of subjects, the correlations over 
a five-year period or longer tend to be 
;+ ;80 or higher. That is, the ranks of the 
students in a school remain very constant 
over many years of schooling. Many re- 
searchers and educators infer from this 
that differentials in achievement are non- 
alterable and that they are fixed by in- 
telligence, heredity* home influences, or 
other conditions outside the school. It is 
assumed that the student and his back- 
ground' explain this remarkable stability 
of achievement and that the causes or 
remedies are not to be found within the 
schools* H U the student who has failed 
(or succeeded), and the teacher, the in- 
struction, the curriculum, or the school 
are not 10 be held responsible. 

Ut contrast to tests used for grading 
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"When formative test^ anc^corrective procedures are 
used • . as high as 80% or 90% of the students are able to 
rc^ch the-mastery standard, • 



ft 



and judging is the use of tests and ofher 
evidence as an integral pan of the forma- 
tion of the learning, Formative tests arc 
used primarily as feedback, to inform the 
student aljout wh*r he has learned well 
and what he still needs to. team. '-When* 
feedback is provided in relation to correc- 
tive procedures to help the student correct 
the learning, then with additional lime 
and help most students do reach the stan- 
dard of achievement set by 'the teacher, 
Typically, teachers use, a parallel form- 
ative test to determine 'when the student 
has completed the corrective process to 
the set standard. Various studies have 
* found that if 20% of a group of students 
reach the mastery standard on a formative 
test given at the end of a particular learn* 
jng task, then with an hour or two of cor* 
rcctive effort moit of tho itudenti reach 
the same mastery standard, When they are 
rctested on a parallel formative lest. 

When formative tests and corrective 
procedures are used in this way over a 
series of learning tasks* the proportion of 
students rcach'irtg the mastery standard 
(before correctives) increases on each sub- ' 
sequent task until as high as 80% or 90% 
of the students are able \<f teach the 
mastery standard on the final learning 
tasks in the series. The amount of correc- 
tive help needed becomes smaller on suc- 
cessive learning tasks, until only a few 
students mjed such corrective procedures. 
The students appear to be 4 learning to 
learn/ 1 

This use of formative tQsts insures that 
most of the students have the necessary 
cognitive prerequisites tbr each new learn- 
ing task, that students have increased in-,~ 
lercst in learning and greater confidence 
in their own abihtyto learn, and that they 
use more of the classroom time to engage 
actively in the learning process. 

Formative tests are also useful in help* \ 



example of cybernetic feedback-corrective 
procedures necessary for almost all hirf 
man activities. In tutoring situations the 
one-to-one relatiop provide? so many cues 
that the feedback-corrective prpcets is 
almost a natural interactive exchange be- 
tween tutor and tutce. However, group 
learning is central in the schools, and it is* 



actcristics of all teaching: cuts, reinforce- 
WW, and participation:* Cue* include iri-^ 
struction as to what is to be learned as well 
as directions as to what the learner is to do 
in the learning process. Much of the re- 
search relates student learning to the clar- 
ity, variety, mcaningfulness, and strength 
of*the explanations and directions provid- 



difficult lo provide adequate, feedback- cd by ibe teacher and/or \hc instructional 



correctives for the tcactyer andjhe 30 or so 
learners in each classroom. As a result, 
much teaching may take place with inade- 
quate learning on the part of m^ny of the 
students. Periodic formative testing and 
corrective procedures c^n be Effective as 
one way of insuring that eXccrient learning 
lakes place. However, in'the long run, the 



material. Reinforcement includes the' ex- 
tent to which -the student is rewarded or 
reinforced iq his learning. Much of the 
research relates student learning to the 
variety of reinforcements provided, the 
frequency with which reinforcement is 
used, aijd the amount and.ki^d of rein- 
forcement given to different students in 



basic problem of croup learning is to find di? fta. PmicipaiM ificlucta iiie extern 



ways of providing feedback-corrective 
proem** o» tttt Integral pun of <Ha elm*. 

room teaching/learning interactions. 

Teachers vs. Teaching % 



ing the teacher determine which aspects of 
the learning task were learned well by the 
majority of the students and which were 
learned poorly by most of the students. 
This gives the teacher feedback \f\ order to 
determine which ideas and skills need to 
be reviewed or retaught In a different way 
if the majority of students are to learn 
them to a high standard. The major 
change is that teachers do less in the way 
of judging and grading students on what 
they had learned by a particular date and 
they do more to sec to it that each student 
learns What he o} she needs as preparation 
rot the next learning tnsk(s). 

Formative testing in flation to the cor- 
rective process may be considered as an 



Over the past four decades there has 
been a great deal of research on teacher 
' characteristics and their relations with stu- 
dent learning/This research has been con- 
cerned with such variables as ihe age of 
the teachers, their training, teaching ex- 
perience, membership in teacher Organiza- 
tions, personality and attitudes^and even 
performance on achievement tests related 
to their field of teaching. In general, the 
relationship between teacher charac)eris~ 
tics and student learning has typically 
been represented by correlations of les$, 
than +.20. Researchers in the past may 
not have selected the right teacher charac- 
teristics for study. However^ b ased on the 
jescarcli.done to Jatc, we mayjcpiurludc 
7thaf the characteristics of teachers have 
little to do with the learning of their 
"students. And, even if they did show 
higher relations, most of the character 
istics of teachers studied so far are static 
variables not directly alterable by inscrvice 
or other teacher training programs. 

Different from these many studies of 
teacher characteristics is the more recent 
research on the qualities of teaching that 
have a direct causal relation with student 
learning in the classroom. This research 
on the qualities of teaching (rather than 
on qualities of the teachers) cqpsists large- 
ly of observational and experimental 
studies of teachers interacting wirh their 
students* Although there are many ways 
of doing this research, the theoretical ap- 
proach of John Dollard and Neal Miller 
h^s been found very useful. Dollard and 
Miller have emph^isi/cd thice ii&jor char- 



to which the student actively participate* 
or «Htf*j}o1i |H Ml* UutHing. liii f «Mnr«H 
relates student learning to the extent to 
whicli he actively participates in using the 
cues, makes appropriate responses, and 
practices the responses until they have 
-become a part of his repertoire. The rc- 
t search also includes the .extent to which 
the instructor and/or the instructional 
method engages the different students in 
the class in overt as well as covert par- 
ticipation and response to the learning. 

Observations of teacher interaction 
with students in the classroom reyeal that 
teachers frequently direct their teaching 
and explanations to some students and ig- 
nore others. They give much positive rein- 
forcement and encouragement to some 
students, but not to others, and they en- 
courage active participation in the class- 
room interaction from some students and 
discourage M from others. The studies find 
that typically the students in the top third 
of the class are given the greatest attention 
by tckhers.ivvhile the students in the bot- 
tom third receive the least attention and 
.support, Thcst differences in the inter- 
action between teachers end students pro- 
vide some students with much greater op- 
portunity and cntouragement for learning 
than is provided other students in the ' 
same classroom. * <*> 

These qualities of teaching are alter- 
able as a result of jnfervic* education that 
provides teachers with feedback on what 
tfiey are doing (or not doing) and what 
they can do to alter the situation. Sludies 
have found that when these interactions 
of teachers with their students are altered, 
there are significant improvements in stu- 
dent learning. • * . ■ . 
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conditions of learning for some students 
m the class than for others, generally, 
ihcy arc under the impression that nil stu- 
dents arc given equal opportunity frtr 
Icai ttine „ Wii^n tcadjcLY xii£ Jtdpcil i£ 
secure a moie accurate picture of their 
ov\?> teaching methods and styles of inter- 
action with their students, they arc in- 
creasingly able to provide favorable learn- 
ing conditions for most of (heir students, 
rather than just for the top traction of the 
Class. 

As the qualities of teaching become 
more central than the characteristics of 
the teachers, we shall see more clcudy the 
kinds of training that can improve teach* 
ing and learning. We shall also see mpre 
clearly the variety of conditions that can 
serve in the teaching/learning process. 

w Tutors, aides, patents, and even olliei stu- 
dents can be helpful in promoting learn- 

♦ ing. New materials and media, new or- 
ganization of classrooms, and new rela- 
tions between teachers and students will 
be seen as important in 'contributing to 
learning. 

Parent Stains vs. Home Environment 

Teachers and researchers have long 
known that children from some homes 
learn better in school than children from 
other homes in the same communities. In 
general, learning in the schools has been 
found to be related \o the education and 
occupations of the parents, to the social 
class and socioeconomic status of the par- 
ents, and to membciship in particular 
ethnic groups and races. Studies of socio 
"economic status (winch include parent 
education. Occupation, and income) re 
veal correlations *of + .30 to + .50 be- 
tween such indices And measures. of school 
achievement. While such studies do 
demonstrate significant ' elfccts of, the 
home on school achievement, they are not 
.very-helpful to the schools or the parents, 
because these chaiactertMic* arc not alter- 
able. There ts little the school or the par- 
ents can do to alter rhc^r level of educa- 
tion,. occupation, income, or ethnic char- 
acteristics. While such studies may be of 
some slight va^ue for picdictin»» levels of 
learning of groups of childien, they offer 
no specific clues as to what the schools or 
the parents can do to improve their chil- 
dren's learning. 

In contrast to these earlier studies of 
the characteristics of patents are the more 
recent studies that emphasize what par- 
ents do in interacting with their children, 
these studies use interviews and observa- 
tional techniques to investigate the en- 
vironmental process variables in the 
homes — the interactions between chil- 
dren and their parents. Some of the home 
environmental process variables that ap : 
pear to be most significant arc; contribu- 
tion of 'the. home* to devclopihent of HiC 
m °th rr tongue,' cheoutagement of the 



help in learning when the child most nr-ds 
it, and ways in which time and space are 
organized in the home. Stifh variables^ 
when combined, correlate ^ .70 to + .80 
wjih measures of -school achievement. In 
general, the correlations arc highest with 
school achievement involving reading, 
vocabulary, and problem solving and low* 
est with spelling and arithmetic computa- 
4ion. These results suggest that the home 
has greatest influence on the language 
development of the child, hi$ general 
ability to hrarn, and his motivation to 
Jcam well in school. The home has least 
influence oh specific skills taught primari- 
ly m the school. 

It is clear that when the home and the 
school have congruent learning emphases, 
the child has little difficulty in his later 
school learning. Hut when the home and 
Uie school have divergent approaches to 
life and to learning, the thild^s likely to be 
penalized severely by the school — es- 
pecially when* school attendance is re- 
quired for 10 pr more yean. 

In recent years a large number of 
studies have attempted to alter some of 
these process variables in the home. These 
studies have made use of home visitors, 
special courses for parents, and parent in- 
volvement in the schools for bnef periods 




"Yes, my ohiUI ha% learned a hi from 
iKihhs TV! She's learned fluent Spanish 
i/'.n perfect metrics, neither oj which tter 
wuther understands. " 
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be used at various points in the child's 
development. The research makes it clear 
that many of these prjfKess variable* are 
alterable, and the effects of such altera* 
. lion? on. the children** school learning are 
very great. 

Lven when these vatiables cannot be 
altered in the home, a knowledge of the 
home environmental process variables 
furnishes a basis for programs of early 
childhood and primary education that can 
compensate for particular deficiencies in 
the home. The major point to be madf is 
that there is a Curriculum and teaching 
style in each home and that it is the varia- 
tions in the home curriculum and teaching 
that account for much of the difference in 
'children's preparation for the learning 
tasks in the school: 



Summary 

If wc arc convinced that little . or 
nothing can be done to improve the learn- 
ing of individual students, then our mjjor 
effort must be invested in ptedictinj 
school achievement and classifying chiM 
dren at an early age, Stable variables are. 
ideal for this purpose. Such eflorts rest, t 
in a school syMe^i that is quile effective 
for a small proportion of the students 
while at the same time it dooms most 
students to a deep sense of inadequacy 
and a dislike fojr school and school learn- 
ing. Such a school system must invest 
much in (he way of human and material 
icsourccs with very small returns to the 
society or to the o rnajoiity of it> students. 

If wc ate convinced that a go'od educa- 
tion necessary for all who live in modern 
society, then we must search foi the alter- 
able variables that can make a difference 
in the learning of children and adults in or 
out of the school. Such alterable variables 
will do much to explain the learning proc- 
ess, and they will do even more to directly 
improve the teaching and learning proc- 
esses in the Schools. Our basic research 
task is to furthei understand how such 
alterable variables can be altered and their 
consequent effect on students, teachers, 
and learning. 

The small number of alterable vari- 
ables I have discussed here are only a few 
of the variables that have already been 
studied by reseaichers and used by teach- 
ers. These have already made a great dif- 
ference in our understanding of school 
learning. But, also, they have brought 
about major changes in out views of 
learners and their amazing potential for 
learning. I hope ihatjhis small list will be 
rapidly expanded in the next decade and 
that l h vy will become equally central for 
teachers, parents, and researchers, When 
they aic thoroughly understood and well 
used, they will bring about the most pro- 
found changes in the sv % ho\)l> and in the 
society, O 
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